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Introduction 

Within national and state educational refonn move- 
ments, greater emphasis is bdngplaced on students with 
disabilities being a part of the accountability system. 
Although nearly all students are included in the Texas 
accountability system through their dropout and atten- 
dance rates, over 50% of students with disabilities are 
exempted from state assessments, and there is conad- 
erable variatnlity in the exemption rates within districts 
and campuses. Recent legislation inlbxas (Senate Bill 
1, Texas Education Code, May, 1995) requires that an 
assessment system be developed for all students cur- 
rently exempted irom state assessments, and that their 
performance results be included in the accountability 
system reports. 



Project Assignment 

A statewide stakdiolder group was convoied to develop 
a document for the Texas Education Agency which 
examined the critical issues related to including stu- 
dents with disabilities in the Texas assessment and ac- 
countability system. This focus group was also asked 
to develop a recommended plan of actions designed to 
address the is.<>ues. It was not the charge of the focus 
group to develop * *the solutions** to eadi issue, nor to 
address an extensive set of related issues, although these 
were noted for further consideration (e.g. other stu- 
dents with special needs, quality of the current state 
assessment instrument, adequacy of Individual Educa- 
tional Plans). 

In examining the issues, current state policies, proce- 
dures, and guidelines were taken into account by the 
focus group. The discussion of issues centered more 
around local implementation barriers than whether or 
not standards were in place at the state level. It was 
acknowledged that some remedies should be pursued 
at the policy level. However, with a continuing shift 
toward more responsiblity at the local level (i.e. site- 
based decision making: emphasis of Senate Bill 1), 
oversight of praoices at the local level were designated 
as the greatest challenge. 



Critical Issues 

The Texas Education Agency directed that the issues 
be defined in four major areas: participation, accom- 
modation, reporting, and implementation. The focus 
group reached consensus on a total of 29 issues. A 
brief synopsis includes: 

• Partidpation 

High stakes accountability was seen as the 
underlying barrier to greater partidpation 
rates in state assessments by students with 
disabilities. Related assessment conclu- 
sions centered around local variability in 
decision-making about who should partici- 
pate, the appropriate use of exemptions, 
and a lack of cqtpwpriate assessment op- 
tions. 

• Accommodation 

The allowable use of accommodations for 
state assessments was characterized as in- 
consistent in practice. Qmcems were noted 
about local variability in decision-making 
about the use, soundness, and appropri- 
ateness of accommodations. 

• Reporting 

The need to incorporate assessment results 
for students with disabilities into the ac- 
countability system raised questions of 
where scores should be reported (i.e. home 
campus/district), how tiiey should be re- 
ported (i.e. categorically: change in per- 
formance over time: clearly interpreted), 
and whether they should be reported dif- 
ferently (i.e. separately from data for non- 
specid education students: standard ad- 
ministration vs. use of accommodations/ 
alternative assessments). 
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• Implementation 

To implement expanded assessment 
and accountability systems in Texas, 
obstacles to be overcome were identi- 
fied as attitude, limited available re- 
sources, contradictions with existing 
state and federal statutes, and the high 
stakes purposes for which these systems 
are used. 



Assumptions Underlying an Action 
Pian for Texas 

A set of nine assumptions related to assessment and 
accountability guided the completion of the recom- 
mended action plan. The focus group came to consen- 
sus on the basic tenets which would undeily the devel- 
opment of strategies to be recommended to the Texas 
location Agency. 

The assumptions related to the accountability system 
described a single, comprehensive accountability sys- 
tem, characterized as fair, encompassing diversity, en- 
suring continuous improvement, including training pro- 
visions, and supporting the improved performance of 
and expectations for students with disabilities. 

Assessment assumptions centered around the need for 
and development of znaltemative assessment system, 
with assurances of reasonable accommodations and 
compUance with state and federal nondiscrimination 
regulations. 



Recommended Action Plan 

Cleariy, it was more difficult to reach consensus on the 
action plan. It was recognized by the focus group that 
there are not quick, simple, easy-to-implement solu- 
tions to the complex issues identified in this document. 
The strategies recommended in the action plan were 
categorized into three components: networking, re- 
search, and development.Thc development strategies 
were further subdivided into assessment, policy, re- 
porting, and training. Recommendations are sum- 
marized as: 



• Networking 

Strategies were included to eliminate du- 
plication of effort in Texas. These strate- 
gies contained suggestions for formal link- 
ages among Texas, national entities, and 
other states. Collaboration on ongoing 
research and devek^ment activities should 
include those related to: 

a) previously developed alternative 
assessment systems, 

b) decision-making guidelines, 

c) legal issues, and 

d) reporting procedures for state and 
national assessment and accountabil- 
ity systems. 

• Research 

Recommended research strategies encom- 
passed ongoing follow-up studies of stu- 
dents with disabilities to determine the 
appropriateness of exemptions and to track 
the unintended consequences of including 
these students in the assessment and ac- 
countability systems. 

• Development 

Development strategies endorsed by the fo- 
cus group identified the following needs: 

Assessment - Extensive development of an 
alternative assessment system was recom- 
mended, to include an advisory group of 
practitioners to give guidance to future 
state assessment revisions and develop- 
ment cmsiderations. 

Policy - At the policy level, development 
strategies described the need for guidelines 
for decision-making about assessment op- 
tions and appropriate accommodations. 

Reporting - Reporting strategies focused 
on the need for a reporting system inclu- 
sive of the results for students with disabili- 
ties, with a design for differentiated report- 
ing, a phase-in requirement, an assignment 
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of results to the home campus/district, the 
use of indicators of progress over time, and 
a concise description of the system for 
public use. 

Training • In order to ensure the success- 
ful implementation of new assessment and 
accountaUlity repotting systems, strategies 
were recommended to develop training for 
implementation and for analysis and ap- 
plication of results to district/ campus im- 
provement planning. 



Summary and Implications 

The focus group recognized that the recommendations 
will take time to implement, should be appropriately 
phased in, and will require the allocation of consider- 
able resources. Determination will need to be made 
regarding the intent of the Senate Bill 1 requirements 
net only io develop an alternative assessment system, 
but also to include assessment results in the account- 
ability reports. Many suggestions in the action plan 
will be dependent on the findings of research on addi- 
tional technical issues in the assessment of students with 
disabilities. Other recommendations will require sig- 
nificant changes in the ways in which people think about 
education, assessment, and accountability for all stu- 
dents. However, the ultimate return on the investment 
will be the assurance of accountaUlity for the success 
and progress of all students served by the public school 
system in Texas. 
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A Study of the Issues 



INTRODUCTION 



S tudents with disabilities comprise approximately 
10% of the nation's schoolage population (Six- 
teenth Annual Report to Congress on the Imple- 
meittadon of the Individuals with Disabilities Educa- 
tion Act, 1994). In addition to having single or mul- 
tiple identified disabilities that may interfere with learn- 
ing, they also share educational risk factors with other 
school populations. These may include high dropout 
rates, high unemployment rates, and restricted life op- 
portunities due to limited skill preparation for post- 
school environments (Bates, 1994). 

Educational reform is directed toward measuring 
progress toward educational goals for all of the stu- 
dents served by the public school system. However, 
exclusion finom the accountability system of any por- 
tion of the student population results in decisions be- 
ing made with incomplete data. When students with 
disabilities are left out of the assessment process and 
the subsequent results data, they are also left out of any 
reform effort (Y sseldyke,Thurlow, McGrew, & Shriner, 
1994). 

In order to address this issue in Texas, the Texas Edu- 
cation Agency awarded a six-month grant to the Re- 
gion IV Education Service Center (ESC) in April, 1995, 
to facilitate the work of a statewide focus group of stake- 
holders. The directive of the TEA was to develop a 
document that identifies critical issues related to in- 
cluding students with disabilities in Texas' statewide 
assessment and accountability systems. This document 
represents: 

a) the collective thinking of a focus group of more 
than 20 stakeholders who participated in its de- 
velopment, 

b) consultative advice from TEA staff, 

c) input from statewide advocacy groups, and 

d) fe^back each focus group member solicited from 
the constituent groups they represented. 



The paper includes information on national educational 
reforms in assessment and accountability for students 
with disabilities as related to this movement in Texas, 
and current assessment and accountability practices in 
the state. Based on the critical issues identified by the 
focus group, consistent with continuing Texas educa- 
tional reform, a list of assumptions and a recommended 
action plan were developed. 



Purpose 

This document should serve multiple purposes. First, 
it win identify the progress Texas has made in the de- 
velopment of state policies^rocedutes/guidelines for 
assessment and accountability as they relate to students 
with disabilities. Second, it outline concerns iden- 
tified by the project focus group about how these are 
being implemented in the field. Third, it will provide 
suggested actions that the Texas Education Agency may 
want to consider as it expands the reporting of data for 
students with disabilities in the state's assessment and 
accountability systems. 

Although this work was commissioned and begun prior 
to the completion of the new Texas Education Code 
(TEC) as passed by the 74th Texas legidature in May, 
1995, there was significant tracking of the new legisla- 
tive requironents. Therefore, a fourth and final pur- 
pose of this work should be to support the commis- 
sioner of education, who is required by the new TEC 
(Senate Bill 1, Section 39.027) to develop and propose 
an assessment system for evaluating the progress of 
students exempted from current state assessments. 

The stakeholders worked together during several meet- 
ings as a focus group to (1) verify the extent to which 
issues for other states are issues for Texas, (2) clarify 
critical issues for Texas, (3) identify a set of fundamental 
assumptions to guide assessment and accountability 




11 



1 



Including Students with Disabilities in Statewide Assessment and Accountability Systems: A Study of the Issues 



efforts in Texas, and (4) develop a recommended ac- 
tion plan for addressing the issues in Texas. Much of 
the initial information provided to the focus group was 
drawn from several sources. These sources are identi- 
fied in Exhibit 1. In addition, advocacy groups and 
staff from a number of divisicms within the Texas Edu- 
cation Agency provided the group with extensive in- 
formation. 

The overall focus of this project was to assist Texas in 
moving toward an education^ system that is account- 
able for the results of public education for all students. 
Thus, there are two avenues the group followed. First, 
it examined the critical issues for increasing the involve- 
ment of students with disabilities in statewide assess- 
ments. Second, it looked at the issues related to ac- 
countability for the performance of those students, in- 
cluding those who cannot take the existing statewide 
assessment, recognizing that these students will need 
other assessment options. 




THE NATIONAL. CONTEXT 

T here are many reasons that Texas, like other 
states, is examining the issues surrounding the 
statewide assessment of students with disabili- 
ties. Over the past several years there have been ex- 
tensive efforts to reform education at all levds, with 
increased emphasis on accountalnlity for results. States 
are setting standards for pupil performance, and are ei- 
ther relying on existing state assessment systems or 
developing new systems to track educational progress 
(Office of Tschnology Assessment, 1992). Educational 
programs in the United States have implemented ac- 
countability systems to provide assurances to stakehold- 



ers (both inside and outside schools) that expectations 
for higher levels of student achievement are being met. 
Accountability systems typically include goals, indi- 
cators of success toward meeting those goals, analysis 
of data, reporting procedures, and a set of consequences 
or sanctions. The purpose of amassing indicators of 
results is to determine whether the educational system 
is making expected progress and to guide improvement 
efforts (aark, 1992). 

Unfortunately, most standards-setting, accountability, 
and assessment systems are excluding large numbers 
of students with disabilities (McGrew,'niurlow, Shriner, 
& Spie^l, 1992; Ysseldyke, Thurlow, & Shriner, 1994). 
And, there have been differential rates of exclusion 
among states, and among districts and school campuses 
within states, resulting in: 

• Incomplete information for policy 
formulation, 

• Unfair and invalid comparisoris 
among states and districts, and 

• Decisions that do not take into ac- 
count the needs of students with 
disabilities. 

Concerns about these results have reached the point 
that assessment and accountability systems that include 
all students are being demanded, both nationally and 
in states. A detailed description of what is ha^^ning 
in national data collection programs in the United States 
and in the statewide assessments is provided in Ap- 
pendix B. 

National Data Collection 

The National Assessment of Educational Progress 
(NAEP) is our nation’s “report card.” Yet, up until this 
past year, more than 60% of students with disabilities 
were excluded each time it was administered. The prob- 
lem of exclusion was first recognized in 1990 when 
NAEP results began to be repotted for individual states. 
Analyses revealed that exclusion rates varied among 
states, ranging from 33% to 87%, and that these varia- 
tions affected the ranking of states. Furthermore, it 
became evident that a national data collection program 
was inadequate if it did trot involve all students who 
were in the educational system. Major dianges in 
NAEP and other national data collection programs have 
occurred as a result of these findings. For example: 

• In 1992, samiding for the National 
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Education Longitudinal Study was 
redesigned to overcome the exces- 
sive exclusion of students with dis- 
abilities from its samples. 

• In 1993, interviews for the Na- 
tional Adult Literacy Survey were 
revised to allow for the participa- 
tion of more individuals with dis- 
abilities, and data on the perfor- 
mance of individuals with disabili- 
ties were reported. 

• In 1994, the National Center for 
Education Statistics (NCES) be- 
gan exploring ways to increase the 
participation of smdents with dis- 
abilities in NAEP. 

• In 1995, NCES received approval 
from the National Assessment 
Governing Board to take the ap- 
propriate steps to make increased 
participation possible (by using 
revised guidelines) and to explore 
the use of accommodations by stu- 
dents needing them. 

■■■ Statewide Assessments 

States likewise are actively addressing how to increase 
the participation of students with disabilities in their 
accountability systems. In most states, accountability 
measurements are based solely on test scores. Some of 
what is known about state tests is: 

• In the past, many states included 
less than 25% of their students 
with disabilities in the statewide 
assessment. 

• Exclusion from statewide assess- 
ments has occurred when tests are 
developed, when tests are admin- 
istered, and when results are sum- 
marized or reported. 

• While most states allow the use of 
accommodations during assess- 
ments, the accommodations that 
may be used vary by state as well 



as within states according to the 
disability or the specific test. 

• Both the application of guidelines 
for making decisions about par- 
ticipation and the determination of 
appropriate accommodations vary 
among school districts and school 
campuses within states. 

During the past five years, states have been more sen- 
sitive to the exclusion of students with disabilities from 
statewide assessments. Among the evidence of this 
movement is: 

• Some states have now developed 
new assessments and accountabil- 
ity systems to dramatically in- 
crease the participation of students 
with disabilities. 

• Recent federal legislation has 
made it requisite that states in- 
clude all students in their account- 
ability and assessment systems. 

These include reform legislation 
(Goals 2000), elementary and sec- 
ondary education (Improving 
America’s Schools Act), and tran- 
sition to work (School to Work Op- 
portunities Act). 

• The new Individuals with Dis- 
abilities Education Act (IDEA) is 
expected to require that students 
with disabilities be participants in 
state assessments. 

• Proposals for federal funds have 
been solicited to address the tech- 
nical issues in the participation of 
students with disabilities and the 
use of accommodations. 

• The Council of Chief State School 
Officers (CCSSO) is forming a 
State Collaborative on Assessment 
and Student Standards (SCASS) 
for states to work on issues related 
to assessment of students with dis- 
abilities. 
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All of these events reinforce the need to identify and 
address issues related to including students with dis- 
abilities in the Texas assessment and accountability 
system. 

ASSESSMENT AND 
ACCOUNTABILITY 
PRACTICES IN TEXAS 

I n 1994-95, there were more than 350,000 students 
with disabilities served by Texas public schools. 
The academic performance of approximately 47% 
of them was evaluated in the most recent administra- 
tion of the statewide assessment, the Texas Assessment 
of Academic Skills (TAAS). Currently, the major 
sources of accountability for the perfonnance of stu- 
dents with disabilities in Texas schools are the Indi- 
vidual Educational Plan (DEP) and the Results-Based 
Monitoring (RBM) system. In practice, whether lEPs 
are appropriate, well-developed, or used for planning 
needs review (see Appendix D). The RBM system 
monitors program compliance and examines continued 
student growth, but does not yet connect results to the 
statewide accountability system. 

To avoid confusion, it is necessary to differentiate be- 
tween assessment systems and accountability systems. 
The assessment system is a subset of the accountability 
system, and includes the TAAS and end-of-course ex- 
ams. In Texas, the accountability system includes data 
from several indicators to make judgments about how 
campuses, districts, and the state as a whole are per- 
forming (see Appendix C for a listing of resource docu- 
ments extensively used as a foundation for the infor- 
mation contained in this section). 

All students in Texas public schools are currently in- 
cluded, at least partially, in the accountability system 
(see Figure 1). Students with disabilities are included 
when attendance rates and dropout rates are calculated, 
and therefore are factored into the accountability rat- 
ings. However, students with disabilities are not fac- 
tored into the data on performance in the assessment 
portion of the accountability system. Even though over 
40% of students with disabilities do take the TAAS, 
their performance is not counted when accountability 
ratings are calculated. Separate data are available to 
districts on the performance of students with disabili- 
ties when they take the TAAS, but the data are not re- 
potted as part of the accountability rating system. 



The Texas Education Code in Senate Bill 1 (Section 
39.027) requires that not later than December 1 , 1996, 
the cotrunissioner shall develop and propose to the leg- 
islature an assessment system for evaluating the 
progress of students exempted from the state assess- 
ment. Not later than the 1998-1999 school year, the 
performance of students who participate in that system 
must be included in the academic excellence indicator 
system, the campus report card, and the performance 
report Meeting this mandate will require a review of 
the current system. The information in this section pro- 
vides a description of some of the history of the Texas 
assessment and accountability systems, an overview of 
the current systems, and the extent to which students 
with disabilities are involved. 



History of State Assessment and 
Accountability 

Students with disabilities have always been included 
to some extent in the Texas state testing process and 
participation rates have always been reported. As Texas 
moved from testing with the TABS (Texas Assessment 
of Basic Skills) to the TEAMS (Texas Educational As- 
sessment of Minimum Skills) tests, students with dis- 
abilities participated with limited allowable modifica- 
tions. The introduction five years ago of the TAAS 
tests moved assessment of basic skills to higher aca- 
demic levels, including higher order thinking and prob- 
lem solving skills, with tests beginning in the third 
grade. 

Field testing of the TAAS has not excluded students 
with disabilities and districts have been allowed to pro- 
vide certain modifications, although no Braille version 
was provided in the initial field test. Since then, stu- 
dents taking Braille versions of TAAS tests take the 
embedded field test items included each time TAAS is 
administered. 

In the initial TAAS testing years, students with disabili- 
ties were either exempt from the test administration, or 
their scores were reported in the district's results for 
special education students. These ’'cores were also in- 
cluded in the district's report of rest Its for all students. 

Pariicipation. For the 1992-93 test administration, the 
first non-standard administration (oral) was allowed. 
In 1993-94, exempted students at all tested grades ex- 
cept exit level could be administered the TAAS tests 
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for local evaluative purposes. Results for all exempt 
special education students were not aggregated ' nth 
the results for non-exempt special education students. 
T^e determination of accountability ratings for districts 
and campuses did not include results for exempt or non- 
exempt special education students. Students assessed 
under these circumstances were able to receive more 
extensive modifications, if needed, since they were not 
required to be tested under standardized conditions. 

During the past three years’ administrations of the 
TAAS, an average of 4% of all students eligible to take 
the exit test were exempted by the Admission, Review 
and Dismissal (ARD) committee. For the 1993-94 test- 
ing, over 50% of the total special education population 
in Tbxas was exempt from all levels tested, with 47% 
participating in the TAAS. There were no special ex- 
emptions for the new end-of-course exams (algebra and 
biology) unless significant content modifications were 
made for students in these courses. However, the tests 
could be administered for local purposes to students 
whose lEPs specified content modifications (see "Ques- 
tions and Answers on Senate Bill 1," TEA, 1995). 

Accoirimndations. Allowable accommodations for the 
TAAS have been compared favorably with those of 
other states (see Exhibit 2). The current Texas Ad- 
ministrative Code establishes that specific modifica- 
tions for TAAS be outlined in the test administration 
materials (see Appendix E). The nonstandard oral 
administration allowance continues to be a part of the 
testing process. In addition, there is a process for re- 
questing additional accommodations, and these are con- 
sidered by the Texas Education Agency on a case-by- 
case basis. 

Reporting. Due to expressed concerns about the mis- 
use of aggregated test data to compare districts, changes 
were made in methods of reporting testing results. Ini- 
tially, media reports included the data of all students 
test^, with inaccurate comparisons being made be- 
tween school districts, 'fhat is, not all districts used the 
same process for including students with disabilities in 
the test administration, and comparisons were not be- 
ing made on the same sets of data. 

Beginning with the 1992-93 reporting, results were no 
longer reported by disability (although separate data 
had been repotted through 1991-92). Beginning with 
the 1993-94 reporting, the "all students" report was 
eliminated and only the disaggregated TAAS data of 
non-special education students were used for compari- 



sons between school districts. 

All special education students’ TAAS data were in- 
cluded in a separate report, even if they were placed in 
all regular education classes and were not exempted 
from testing by ARD committees. In addition, only 
limited data have been collected or reported for the types 
or frequency of modifications used in the TAAS ad- 
ministration. Currently, data are collected regarding 
the use of oral administration for math and on tests ad- 
ministered in Braille or large print (TEA, 1995). 



Im plementation. Hie stakes in Texas can be quite high. 
Most notable, the following are included in state stat- 
ute: 

• Accountability ratings are 
given on an aimual basis to 
each district and campus 
based on TAAS results of non- 
special education students, 
and dropout and attendance 
rates of ^ students (including 
special education students). 

• Performance data included in 
Texas’ Academic Excellence 
Indicator System (AEIS) may 
be used to evaluate respon- 
sible educators in the public 
education system, from the 
commissioner of education to 
district superintendents to 
campus principals to class- 
room teachers. 

• Consequences for lower or 
decreased ratings range from 
peer review visits up to and 
including district oversight by 
monitors and/or masters. 

• Financial incentives are also 
possible for those districts/ 
campuses receiving exem- 
plary ratings. 

Accountability ratings or labels carried by campuses 
or districts may impact the relationship between schools 
and their communities. 

hi 
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In an effort to ensure that every campus receives an 
accountability rating, even though students may not be 
tested in those grade levels (i.e., Pre-K to 2), those cam- 
puses receive the same ratings as feeder schools with 
which they are paired. Alternative campuses are given 
accountability ratings on either the standard criteria or 
may choose the option of being evaluated tmder differ- 
ent performance standards (Accountability Manual, 
1995), and their data are included in the district reports. 

Students with disabilities are currently able to receive 
a diplonia upon completion of their lEP. However, the 
74tli legislature did consider requiring all students with 
disabilities to pass the TAAS test to receive a diploma. 
It could be harmful to students with disabilities if this 
were to happen. 

State Assessment System 

The statewide assessment system in place in Tfexas was 
designed to evaluate the performance of students in 
public schools. The Texas Assessment of Academic 
Skills (TAAS) is a criterion-referenced assessment, 
based on the essential elements of the curriculum. 

Description of Assessment System 

TAAS specifications were developed to correlate es- 
sential elements to instructional targets. The state tests 
are designed to assess student competencies in: 

• reading, writing, math, science, and social 
studies (at state determined grade levels 3-8) 

• secondary exit level tests in math, English 
language arts and writing 

• end-of-course exams in Algebra I and Biology 
I (with additional tests to be developed in 
English and U.S. History). 

To receive a high school diploma, students must meet 
passing standards on the exit level tests in English lan- 
guage arts, writing, and math or on specified end-of- 
course exams once they are in place (see "Questions 
&Answers on Senate Bill 1," TEA, 1995). 



Current State Assessment Practices Related 
to Students with Disabilities 

By decision of the Admission, Review and Dismissal 
(ARD) committee, students with disabilities may : 



a) take the standard TAAS, 

b) take the TAAS with allowable modifications, 
or 

c) be exempted from the TAAS. 

No alternative system is yet in place for students with 
disabilities. The only alternative nieasures used inTexas 
are those for students of limited English proficiency 
(LEP). State Board of Education rules for student as- 
sessment were revised in January, 1994 to address the 
testing of LEP students. Although fliese students may 
be exempted from taking the English TAAS, academic 
progress must be assessed with alternative measures. 
In essence, each of these students must be tested with 
grade appropriate English TAAS, grade appropriate 
Spamsh TAAS (as available), or alternative assess- 
rnents. The alternative measures must be valid and re- 
liable. Alternative assessment reports must show stu- 
dent improvements in reading, writing and mathemat- 
ics. Criteria must be reported which are used to deter- 
mine “appropriate improvement” to insure that students 
are making sufficient progress to pass the English 
TAAS. A list of approved tests which may be used for 
alternative assessments is provided by the TEA. 

Results for students with disabilities who take the 
TAAS, with or without modifications, are currently 
compiled as a separate report fiom the rest of the stu- 
dent population. Students with disabilities are not in- 
cluded at this time in the requirement of passing the 
exit level TAAS as a condition of receipt of their diplo- 
mas. The exception to this occurs when the ARD com- 
mittee recommends that the student complete the mini- 
mum academic credit requirements applicable to non- 
special education students, including passing the exit 
level as^sment The TAAS results for students with 
disabilities are not included in the accountability sys- 
tem for the campus and district Senate BUI 1 (1995) 
requires the development of an assessment system for 
evaluating the progress of students exempted from state- 
required assessments ( Section 39.027c.). 

Other Assessment Efforts 

A series of Special Education Effectiveness Studies 
have been undertaken to study student performance 
in life skiU areas of education, employment, indepen- 
dent living, recreational, social and leisure skills (see 
State Plan for Special Education in Texas, 1995). 

These studies include: 



7 




Including Students with Disabilities in Statewide Assessment and AccountabiUty Sy Jtems: A Study of the Issues 



• A retrospective study Ci 250 students who 
have exited the public schools prior to the 
requirement of an Individual Transition Plan 
(TTP): The study tracks productivity, integra- 
tion into the community, and independence. 

• A longitudinal study of 1000 students for four 
years follovring school exit: The study 
tracks outcomes regarding the appropriateness 
of the essential elements and students’ success- 
ful integration into the community. 

• A study of 300 special education students in 
their final school year: The study focuses on 
low incidence populations (e.g. severe disabili- 
ties, etc.) and Ae effects of the transition 
process, i.e. placement at graduation, service 
needs, and the lEP-ITP relationship. 

• A case study approach in 5-6 Texas communi- 
ties of the family-community experience: 

The study focuses on satisfaction and quality 
of services from public education, state 
agencies, and private providers, i.e. degree of 
preparation, interpersonal relationships, access 
to services, employment, and corrunumty 
acceptance. 

H State Accountability System 



An integrated accountability system is in place which 
is used to evaluate the performance of the 1050 public 
school districts and more than 6000 campuses in Texas. 
This system incorporates required district and campus 
data which are used to generate: 

• district accreditation status, 

• campus ratings, 

• district and campus recognition for high perfor- 
mance and performance improvement, and 

• campus, district, and state-level reports. 



Description of Accountabiiity 
System Reporting 

Accountability forlfexas public school system perfor- 
mance is examined through the use of three perfor- 



mance indicator reports. These include the Academic 
Excellence Indicator System (AEIS), the School Re- 
port Card, and the Performance Report District ac- 
creditation status and campus ratings depend on meet- 
ing state assessment, dropout rate, and attendance rate 
standards. 

Academic Excellence Indicator System (AEIS) 

The Academic Excellence Tndicator System (AEIS) 
includes profile information regarding school and dis- 
trict staff, students and finances. Campus and district 
performance on indicators used as the b^is for account- 
ability ratings, rewards, and reports are the major com- 
ponent of the AEIS (see Figure 2). 

As a performance indicator report, AEIS includes the 
following campus and district data: 

Indicators in Place through the 1 994-95 school year 
(Accountability Manual, Febmary 1995) 

1. Passing rates on required assessments 
(Subchapter B [TEC]) 

2. Enrollment and counts of students tested 

3. Attendance rate 

4. Dropout rate 

5. College admissions results (SAT/ACT) 

6. Advanced course completion 

7. Growth on the Texas Learning Index (TLI) 

8. TAAS/TASP equivalency 

Revised indicators (Senate Bill 1, Section 39.051) 

1 . Results of assessment instruments required 
(Subchapter B [TEC, Senate Bill 1]) 

2. Dropout rate 

3. Student attendance rate 

4. The percentage of graduating students who pass 
secondary exit-level assessments (TAAS/TASP 
equivalency) 

5. Percentage of graduating students who complete the 
recommended high school program (SBOE) 

6 College admissions results (SAT/ACT) 

7. Percentage of students taking end-of-course exams 

8. Percentage of students exempted from the 
assessment program 

Minimal changes to the indicators resulted fiom Sen- 
ate Bill 1. Most notably, the percentage of students ex- 
empted from the assessment program was added and 
the percentage of students taking the end-of-course 
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exams was stipulated along with those completing the lyzed ("Questions and Answers on Senate Bill 1 TEA, 
recommended high school program. 1995). 



School Report Card 

The Texas Education Agency is required by statute to 
produce a School Report Card for eveiy campus in the 
state. Each campus is required to provide a copy to the 
parent or guardian of eveiy student. Under the require- 
ments of TEC [Senate Bill 1] (Section 39.052), the 
School Report Card is to include: 

1. the AEIS (indicators 1 through 8), 

2. student/teacher ratios, and 

3. administrative and instructional costs per student 

Performance Report 

An additional indicator of public school system ac- 
countability is an annual performance report describ- 
ing the educational performance ratings (accreditation 
status) of the district and each campus in the district. 
The report includes campus performance objectives and 
progress toward those objectives. The report is to also 
include a comparison of the performance of each dis- 
trict and each campus to previous performance, to state- 
established standards, and to “comparable improve- 
ment” (measured against a “profile developed from a 
state total student performance data base which exhib- 
its substantial equivalence to the characteristics of stu- 
dents served by the campus or district” [Accountabil- 
ity Manual, February, 1995]). 



Accreditation Status 

AEIS Indicators 1 through 6 are those to be used to 
determine accreditation ratings for campuses aixi dis- 
tricts. In practice, these are subdivided into base indi- 
cators and additional indicators (see Figure 2). Base 
indicators are those required to meet minimum accredi- 
tation standards. Additional indicators are used for ad- 
ditional acknowledgment and to measure performance 
beyond the minimum. Districts and campuses may be 
rated as exemplary, recognized, accredited/ accept^le, 
or accredited warned/ unacceptable. Data do not yet 
exist for all indicators, and standards have yet to be 
determined once actual performance results are ana- 



Accountability Systems Reporting 
as Related 

Students with Disaoilities 



Academic Excellence Indicator System (AEIS) 

In the profile section, data for students with disabilities 
currently appear as separate reports from non-special 
education students for number of graduates and reten- 
tion rates (due to wide variation in local retention prac- 
tices). 

Data for students with disabilities have been aggregated 
in the data and campus reports for enrollment, atten- 
dance, dropout, college admissions tests and advaiKed 
course completion. Disaggregated assessment data are 
reported in a separate document. Growth on the Texas 
Learning Index (TLI) is based on student progress 
across grades in reading and math (TAAS scores) and 
has not been planned to include data for students with 
disabilities (see Figure 3). 

School Report Card Related to 
Students with Disabilities 

Data included for students with disabilities consists of 
those AEIS indicators described previously, student/ 
teacher ratios, and cost data. With the new AEIS indi- 
cator of number of students exempted, this new infor- 
mation should now appear and be reported to parents 
as a new element on the School Report Card (see Fig- 
ure 3). 



Performance Report Related 
to Students with Disabilities 

Information on students with disabilities is to be in- 
cluded in the performance report to the extent that it is 
already included in the reports which impact the dis- 
trict and campus accreditation ratings. That is, no as- 
sessment results are included. Data are included for 
enrollment, attendance, dropout rate, college admissions 
data, and advanced course completion (see Figure 3). 
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Current Educational Reforms Related to 
Assessment and Accountability 

Two additional effoits are underway in Texas which 
are correlated to the assessment and accountability sys- 
tems. One of these is the re-defining of the core areas 
for curriculum, the Essential Knowledge and Skills 
Clarification process. The statewide assessment sys- 
tem is based on these content standards. The second 
effort is a new monitoring system which reviews stu- 
dent performance and program operations for all spe- 
cial programs in 'Ibxas' school districts. 



Essential Elements/Essential Knowledge 
and Skills Clarification Process 

The Essential Elements of instraction for Texas public 
schools were developed as a result of a legislative di- 
rective, were adopted in 1984, and were first imple- 
mented in the 1985-86 school year. Currently, a clari- 
fication process is underway which represents the sec- 
ond five-year review. This review will yield the Essen- 
tial Knowledge and Skills for all subjects taught in kin- 
deigaiten through grade 12. These core areas of knowl- 
edge and skills must be included in the foundation cur- 
riculum and will be used for guidance in the enrich- 
ment curriculum for Texas public schools. 

Included in the charge to the clarification teams is that 
the Essential Knowledge and Skills must be appropri- 
ate for special populations. The product will specify 
what all students should know and be able to do, as 
well as specify levels of performance. The product will 
serve as the foundation for the statewide assessment 
system. The clarification process is underway for all 
content areas and field review is scheduled for comple- 
tion in the spring of 1996. 



Results-Bssed Monitoring (RBM) 



The Results-Based Monitoring System began in 1992- 
93 as a pilot with 16 districts. The pilot continued in 
1993-94 with an additional 50 pilot sites. For both pi- 
lot years, each district was monitored for aU programs 
covered by the RBM system. During the 1994-96 
benchmark year, approximately 140 new districts will 
collect data on one or more special programs. 

Indicators for the AEIS, disaggregated by program, in- 
clude: 

1. the percentage of students who pass TAAS 

2. the attendance rate 

3. the dropout rate 

Performance indicators center around continued growth 
of students over previous performance results. Specifi- 
cally, the following are evaluated: 

a. continued growth of students dismissed from spe- 
cial education into general education 

b. continued growth of students served in integrated 
educational settings 

c. continued growth in areas related to disabilities 

d. continued growth toward areas identified in the 
Individualized Transition Plans 

e. employment, postsecondary education or 
training involvement for previous year 
graduates 

f. retention rate 

Continued growth is measured by both formal and in- 
formal measures. Assessment may include the TAAS, 
alternative assessments, parent report, teacher report, 
or other measures. These student performance results 
are utilized locally and are intend^ to guide planning 
for improvement. This may include a consultative visit 
from toe TEA. However, toe results are not used to 
trigger compliance exceptions, data verification visits 
from toe Texas Education Agency, or accountability 
ratings. They are merely ways in which data is col- 
lected for analysis and are not yet tied to public account- 
ability for what is found. 



Results-Based Monitoring is a monitoring system for 

assessing student performance and compliance in spe- CRITICAL ISSUES 
cial programs. Local staff assess how well students 

are performing and whether toe special program is op- r | 1 o develop toe issues related to itKluding students 
eratirig in accordance with program requirements. This I with disabilities in the state's assessment and ac- 

local assessment helps identify program strengths, pri- JL countability systems, the focus group proceeded 
orities for improvement, and any needed corrective ac- with two basic considerations. Rrst, some issues were 

tions. thought to correspond to oversight needs at the state 
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level for monitoring and policy development Secondly, 
however, the emphasis of Senate Bill 1 (as well as site- 
based decision-making) reinforced the shift of respon- 
sit^Q^ to the local level for educational practices and 
results. Therefore, local implementation practices were 
identified as the greatest diallenge. In foe creation of 
solutions to the issues identified in this document it 
will be important to determine which areas are appro- 
priate for foe state to address and which ones should 
be regulated locally. 

The many issues in foe Texas statewide assessment of 
students with disabilities are grouped into foe four broad 
areas idoitified by foe Texas Education Agency: par- 
ticipation, accommodoHon, reporting, and implemen- 
tation. Issues outside of foe four areas, or those not 
considered to be a part of the charge to foe focus group, 
are listed as related issues in Appendix D. 



Participation issues 



Ten participation issues were identified by the focus 
group. Two of foe issues are relevant to participation 
in accountability systems, while the other eight are spe- 
cific to participation in state assessments. All are listed 
here first, then each is discussed for clarification. 

Accountability 

1 . A combination of high stakes 
accountability and exclusion of test 
scores for students with Usabilities 
leads to many unintended conse* 
quences. 

2. There is disagreement about responsi* 
bility for educational results for 
students with disabilities. 



5. Exemption rules are iqsplied differ- 
ently across settings, and adherence to 
exemption guidelines is not moni- 
tored. 

6. The lack of adequate accommodations 
or alternative assessment systems 
keeps many studeius with disabilities 
from participation in state assess- 
ments. 

7. There are questions about whether 
decisions about participation should 
differ as a funcUon of tne severity of 
disability or the category of disability. 

8. The reliability, validity, and appropri- 
ateness of many assessments are 
Questionable for students with 
disabilities. 



Participation in Accountability Systems: 

Issue 1. A combination of high stakes accountability 
and exclusion of test scores for students with disabili- 
ties leads to many unintended consequences. 

Cunent research indicates that there are at least five 
unintended consequences of high stakes testing sy^ems: 

• Increased retention of students at 
grade level, 

• Increased referral of students to 
special education. 

• Increased occurrences of drop- 
ping out of school, 

• Placement of students in separate 
classrooms or buildings, and 

• Misleading comparisons of test 
performance among districts and 
home campuses. 



Assessment 

1. There is disagreement about which 
students with disabilides should 
participate in state assessments. 

2. Large numbers of students with 
disabilities are exempted by ARD 
committees from state assessments. 

3. Concerns exist about die role and 
function of the ARD committee 
related to decisions about participa- 
tion in state assessments. 

4. Students with disaUlities in unique 
set^s (e.g. separate schools, 
institutions) ate routinely excluded 
from state assessments. 



All of foese unintended consequences have eifoer been 
documented or iiifoimally reported to be occurring in 
Texas. For example, increased referrals to special edu- 
cation have been noted after foe first administration of 
the exit exam in lOfo grade and referrals to special edu- 
cation continue into grade 12 (see TEA letter, 1992, 
Appendix D). 

The exclusion is^e in Texas is directly related to is- 
sues of representation. When decisions are made about 
schools, districts, or classrooms based on performance 
data, and data concerning students with disabilities are 
excluded, foe decisions do not reflect consideration of 
foe needs of students with disabilities. In some cases, 
students with disabilities are “out of sight," and there- 
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fore “out of mind,” in the planning process for helping 
schools or districts improve student perfonnance. 



Participation in Accountability Systems: 

Issue 2, There is ^agreement about responsibility 
for educational results for students with disabilities. 

Research in other parts of the country has documented 
that there does not always exist a belief in shared re- 
sponsibility by all adults in the school for the educa- 
tion of students with disabilities (Ysseldyke, 
Christenson, & Thuilow, 1993). While this research 
has not been conducted in Texas, focus group mem- 
bers and their constituents viewed the application of 
this finding to Tbxas as appropriate. Even though a 
student may spend most of his or her day in the general 
education classroom, the student who receive.*! special 
education services may still be viewed as the responsi- 
bility of the special education teacher. This view is 
supported when the TAAS scores of the special educa- 
tion student do not coum in performance ratings, even 
if the student takes the test If the student has mastered 
tl.j content areas that are covered in the regular class- 
room and evaluated by TAAS, his or her performance 
will still not be included in the campus report card. 

This disagreement about responsibility for results is 
increased when students with disabilities receive all or 
part of their instruction in separate settings (other than 
home campus) or outside their district of residence. 
Who will be accountable, who will assume responsi- 
bility (often translated into rewards or sanctions) for 
the results of education for students with disabilities, 
including those who receive all or part of their instruc- 
tion in separate classes, settings, or districts? 



Participation in Assessments: 

Issue I. There is disagreement about which students 
with disabilities should participate in state assess- 
ments. 



does rx)t appropriately measure some student's ability 
level. Some would exempt only those students widi 
severe cognitive impairments. Others would exempt 
any student 'who mi|^thave a agnificant learning prob- 
lem. And yet others would exempt only students with 
behavior disabilities because their potentially disrup- 
tive behavior might depress the performance of other 
students taking TAAS. Finally, many people believe 
that all students should participate in state assessments, 
but to do so will require the addition of an alternative 
assessment for some students. 



Participation in Assessments: 

Issue 2. Large numbers of students with disabilities 
are exempted by ARD committees from state assess- 
ments. 

In Texas, the ARD corrunittee has responsibility for 
making decisions about participation in TAAS. Large 
numbers (approximately 53%) of students with disabili- 
ties are eiAer exempted from the TAAS, as recom- 
mended by the ARD committee (Briand, 1995; NCEO, 
1995), or are not even considered as part of the pool of 
students who should take TAAS. Among the latter 
group are students who are in residential settings. Stu- 
dents in alternative learning environments may or may 
not take TAAS depending on the approach chosen by 
the school. 

In reports of current practices, decisions regarding the 
exemption of a student from TAAS show inconsistent 
patterns. Decisions may range from few exemptions 
to most students with disabilities being exempted from 
TAAS to only students with certain categories of dis- 
abilities being considered as eligible to take TAAS, 
rather than it being an individual decision as intended. 

Participation in Assessments: 

Issue 3. Concerns exist about the role and function 
of the ARD committee related to decisions about par- 
ticipation in state assessments. 



Although there is general consensus that all students 
should be a part of the accountability system, there ap- 
pears to be disagreement about the meaning of “all” 
when used in reference to the TAAS. Few educators 
or parents in Texas would propose that “all means all,” 
that it means all students should participate in the 
TAAS. Some people believe that there are some stu- 
dents who should be exempted from TAAS because it 



Although the TEA has issued guidelines for participa- 
tion of students >vith disabilities in the TAAS, there are 
continuing concerns about how decisions are being 
made as to whether students >vith disabilities partici- 
pate. In Texas, the ARD committee is given that re- 
sponsibility. ARD committees are charged with mak- 
ing the decisions to support individualized education 
of students with disabilities. However, training inap- 
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propriate practices for making decisions about the par- 
ticipation of students with disabilities in assessments 
is felt to be needed. There is some concern that the ARD 
committee members need mote guidelines for how to 
implement the criteria for deciding who should partici- 
pate, that they may act to exempt when in doubt, or 
that they may be overly benevolent in ex^pdng stu- 
dents from tests because of a lack of assessment op- 
tions. 



Participation Ui Assessments: 
issue 4. Students with disabilities in unique settings 
(e.g., separate schools, institutions) are routinely ex- 
cluded from state assessments. 

Students who attend schools in unique settings such as 
institutions, other residential placements (e.g.. school 
for the deaf), and alternative campuses may not be in- 
cluded in TAAS. When results are drawn for analysis 
and review by grade level or only from traditional 
schools, many students are not on the initial list from 
which names ate drawn. Even when all students are 
tested, these students typically are left out 



Participation in Assessments: 

Issue 5. Exemption rules are applied differently across 
settings, and adherence to exemption guideUnes is not 
monitored. 

The guidelines for decision-making about the partici- 
pation of students with disabilities in TAAS may be 
applied differently in different home campuses or dis- 
tricts, and this results in variation in the proportions 
and kinds of students who are exempted from TAAS. 
When this happens, comparisons among home cam- 
puses and districts are invalidated. Currently the ac- 
countability system in place does not determine what 
strategies ARD committees use to determine whether a 
student is exempted from taking the TAAS. 

However, a number of system safeguards arc used to 
ensure that student performance is properly measured. 
The system safeguards include the analysis of TAAS/ 
Public Education Information Management System 
(PEIMS) consistency, few students tested, and audits 
ofnon-tested students, including audits for“excesave” 
ARD exemptions. (PEIMS is a system used to track 
student enrollment and participation in special pro- 
grams.) The audit process compares the number of spe- 



cial education students exempted from the TAAS ad- 
ministration by the local ARD committee to the num- 
ber of students receiving special education services. 
Further inquiries are conducted only if the number ex- 
empted from any of the TAAS tests administered is 
greater than the number of students served in ^cial 
education programs. 



Participation in Assessments: 

Issue 6. The lack of adequate accommodations or al- 
ternative assessment systems keeps many students witit 
disabitities from participation in state assessments. 

All of the good intentions about participation in state 
tests go awry if, for reasons of disability, students are 
unable to participate in testing. Some smdents simply 
cannot participate in testing unless acconunodations are 
made or an alternative assessment system (e.g., portfo- 
lio systems) is available. In Texas, there currently arc 
many modifications allowed during the adm inistration 
of TAAS. However, there is no alternative system for 
measuring the perfc .'nance of students who cannot take 
TAAS, even with modifications. 



Participation in Assessments: 

Issue 7. There are questions about whetiter decisions 
about participation should differ as a function oftite 
severity of disability or the category of disability. 

The project focus group felt that different assumptions 
underlie decisions made about who is exempted from 
TAAS, and there are discrep^cies in how the decisions 
are made. Some ARD committee members may be- 
lieve that all students, including all students with dis- 
abilities. should participate in TAAS, with or without 
accommodations. Other members may believe that 
exemptions should be made for students with severe 
impairments or widi specific kinds of disabilities. Some 
desire exonpUons for all students of a specific category 
(e.g., emotionally disturbed, learning disabled). There 
is. of course, little agreement about v^ch categories 
should be excluded. Finally, there is the belief that all 
students should participate in the Texas accountability 
system, and to do so, some, because of their category or 
severity of disability, will need to take alternative as- 
sessments instead of TAAS. 
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Participation in Assessments: 

Issue 8, The reliability, validity, and appropriateness 
of many assessments are questionable for students 
with disabilities. 

Technical concerns that arise when considering large- 
scale assessments include reliability, validity, and ap- 
propriateness. Validity is the major concern — does 
the instrument really measure what it is inteiKied to mea- 
sure? Although currently Texas includes students with 
disabilities in its field test of the TAAS, including stu- 
dents with disabilities, by itself, does not establish the 
validity of a test for a relatively small population of 
students. Sufficient numbers of students with disabili- 
ties need to be included to allow for analysis of their 
data separately. It is important to demonstrate that the 
items Action the same (are not biased) for students 
with disabilities as for students in the general popula- 
tion (by examining item characteristic curves or per- 
centage of students answering each test item correefly), 
and to look at the extent to which the structure of the 
test is the same for students with disabilities as it is for 
the students in the general populations (through factor 
analysis). A related issue is whether the TAAS is an 
accurate representation of the instmctional program of 
some students (i.e. those receiving more nonacademic 
programs). 

There are also concerns about the appropriateness of 
TAAS for students with disabilities who have not pre- 
viously been included in the field tests (since partici- 
pation is decided in the same way as during regular 
TAAS administrations). That is, participation may have 
been limited to types of abilities and/or disabilities dur- 
ing field testing. There is the potential of new students 
taking the test who demonstrate abilities/disabilities dif- 
ferent from those students included in the original field 
test group. The need then arises to question whether 
the test is also appropriate for the types of students who 
were not part of the field test 



^^■Accommodation Issues 

When students with disabilities participate in assess- 
ments, accommodations may be needed to enhance their 
success. Ceitain modifications are allowable for stu- 
dents taking the standard state assessments and the end- 
of-course examinations. The text from the TAAS Co- 
ordinator Manual (Spring, 1995"> is included in Appen- 
dix D with the exact modificauons and circumstances 



stated. TEA considers other modifications on a case- 
by-case basis. Decisions about the use of modifica- 
tions are made on an individual basis and take into con- 
sideration the needs of the student and whether the stu- 
dent receives that modification during classroom in- 
stmetion. Modifications that would invalidate the test 
are not allowable. 

Seven accommodation issues were identified by the 
focus group as relevant to current allowable accom- 
modations for TAAS administration in Texas. These 
issues are listed here first, then each is discussed for 
clarification. 

1. There is unwillingness to provide al- 
lowable accommodations. 

2. Some people believe some accommo- 
dations give students an advantage over * 
odier students. 

3 . There is disagreement about what **rea- 
sonable accommodations” means. 

4. Multiple issues exist related to each of 
the specific accommodations (e.g., ex- 
tended time, reading aloud, Braille, use 
of calculators, word processors, scribes, 
tape recorders, etc., oral antVor sign 
language interj^eting). 

5. Controversy exists about whether the 
use of accommodations changes what 
is assessed. 

6. There is disagreement about whether 
accommodations should be disability- 
specific. 

7. There is concern about whether the 
same kinds of accommodations used in 
instruction should be used in assess- 
ments. 

Issue 1. There is unwillingness to provide 
allowable accommodations. 

In some districts and home campuses, accommodations 
in testing are not widely permitted. While accommo- 
dations are allowed in Texas and included in written 
guidelines, individual school personnel sometimes ei- 
ther believe they should not be provided, or are un- 
willing to provide them. A concern is that if students 
with disabilities are unable to take TAAS under the 
standardized (non-accommodated) procedures used 
with students who do not have disabilities, then they 
should not be taking TAAS. Certain accommodations 
are seen as potentially changing what the test intends 
to measure, thereby invalidating the results. Another 
complication is that some people are willing to pro- 
vide accommodations for some conditions but not oth- 
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ers, or for some students because of the severity of their 
disability. 



Issue 2. Some people believe that accommodations 
give students an advantage over other students. 

Because not all students use accommodations when 
they take TAAS, some people believe that the accom- 
modations provide an unfair advantage to the students 
using them. Other people aigue that accommodations 
provide the students using them with equity of oppor- 
tunity to respond appropriately, that the accomm^a- 
tions enable students to reflect their true abilities or 
skills rather than providing an advantage. In essence, 
it is believed that accommodations produce a level play- 
ing field. 



Issue 3. There is disagreement about what “reason- 
able accommodations” means. 

In most states there is a call for making ‘reasonable” 
accommodations in assessment. But, what does “rea- 
sonable” mean? Is it reasonable to pay the costs of a 
separate administration? In Texas, written guidelines 
indicate that it is reasonable for a student to use a scribe, 
yet in Connecticut this accommodation is strictly for- 
bidden in written guidelines. Just as different written 
guidelines of different states judge “reasonable” dif- 
ferently, so do individuals within one state, and even 
within a single ARD committee. 



Issue 4. Multiple issues exist t elated to each of the 
specific accommodations (e.g., separate setting, read- 
ing aloud, Braille, use of calculators, word proces- 
sors, scribes, tape recorders, oral andlor sign language 
interpreting). 

It seems that each specific accommodation carries with 
it a set of practical and technical issues. Beyond the 
general issues that have been listed above, there are 
many issues related to specific types of accommoda- 
tions. Some of these are: (1) Is it appropriate to read a 
reading test to a person with dyslexia or a related learn- 
ing disability? (2) Are motivational prompts during a 
long assessment appropriate to provide for a student 
with an attention deficit or an emotional disability? The 
list of specific questions about accommodations could 
be quite lengthy. 



Issue 5. Controversy exists about whether the use of 
accommodations changes what is assessed. 

The validity of an assessment is an index of the extent 
to which it measures what it is supposed to measure. 
To be technically adequate, an assessment must be valid. 
It is considered critical to have the assessment mea- 
sure what it says it measures. If an accommodation 
results in the assessment of something other than what 
the assessment purports to measure, then the validity 
of the results is questionable. The question of validity 
has been raised, for example, with respect to the Braille 
version of the TAAS offered in Texas. Braille is actu- 
ally a specialized tactual code form of the written lan- 
guage. Tactual versions of print diagrams or pictures 
usually convey very different information to the stu- 
dent. When the concept of the test item is based on a 
picture, the validity of the Braille version is question- 
able because it potentially provides different informa- 
tion to the Braille-reading student than the information 
provided to a sighted student by a printed picture. 

Issue 6. There is disagreement about whether accom- 
modations should be disability specific. 

In some states, accommodations that are allowed are 
based on the disability that the student exhibits. There 
are many questions about whether this is an appropri- 
ate approach to take, particularly given the acknowl- 
edged difficulty of differentiating among certain dis- 
ability categories. In Texas, disability category is not 
included in written guidelines as a basis for making 
modification decisions. Yet there is anecdotal evidence 
that these decisions sometimes are categorically based. 



Issue 7. There is concern about whether the same 
kinds of accommodations used in instruction should 
be used in assessments. 

When instruction is provided to students with disabili- 
ties, teachers may provide accommodations that help 
the students to profit best from the instruction. They 
provide these accommodations during all aspects of in- 
struction — when presenting information, when hav- 
ing students practice new skills, and when evaluating 
learning. In the allowable accommodations for Texas, 
instructional modifications are to be considered for the 
TAAS. However, some argue that because not all ap- 
propriate accommodations are provided during instruc- 
tion, accommodations used during assessments should 
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not be restricted to only those used in the classroom. 
Rather, selection of accommodations should be based 
on any allowable option that would improve student 
performance, whether or not it is currently used dur- 
ing instmction. 



When students with disabilities do take TAAS, their 
performances are reported back to school districts and 
home campuses, but the TAAS scores are not included 
in accountability reports. Rather, the only data on stu- 
dents with disabilities included in accountability deci- 
sions are data on dropout and attendance rates. 



Reporting Issues 

Seven reporting issues related to practices in Ibxas 
were identified by the focus group. Five are specific 
to accountability systems, while two are specific to 
state assessments. All are listed here first, then each is 
discussed for clarification. 

Accountability 



1 . There are concerns about students 
whose assessment results are 
reported, but not included in the 
accountability system. 

2. Some believe that the data for 
students with disabilities should be 
reported separately from the data for 
other students. 

3. Categorical reporting of results by 
disability is desired by some but not 
others, and is seen as raising issues 
of confidentiality. 

4. There are concerns related to 
reporting of results of students who 
are not attending their home campus. 

5. There are questions about whether 
results, particularly regarding 
students ^th debilities, are 
communicated in a way ^at is clear 
and easily understood. 



Assessment 



1. There is disagreement about whether 
data obcaineawhen students use 
accommodations or dtemative 
assessments should be repoited 
separately from data obtained under 
standard assessment procedures. 



2. There is a question about the kind(s) 
of scores (e.g., absolute scores or 
change in pmormance over time) 
that Mould be reported for students 
with disabilities. 



Reporting Accountability: 

Issue I, There are concerns about students whose 
assessment results are reported, but not included in 
the accountability system. 



Reporting Accountability: 

Issue 2. Some believe that the data for students with 
disabilities should be reported separately from die data 
for other students. 

Currently, data on students with disabilities who take 
TAAS are reported separately from the data for other 
students. One justification for this is that the data then 
do not “contaminate” the data of general education stu- 
dents. In addition, it is recognized that the TAAS is 
not an appropriate measure for some students who, be- 
cause of their significant cognitive disabilities, have 
different, more nonacademic curricula. Another justi- 
fication for this is that data on students with disabili- 
ties are then available to inform policy and program- 
ming decisions. Because of the way that performance 
data on students with disabilities are reported (sepa- 
rately to the campus or district), there is no require- 
ment that these data be looked at for making decisions, 
nor that they be publicly reported. 

Reporting Accountability: 

Issue 3. Categorical reporting of results by disability 
is desired by some but not others, and is seen as rais- 
ing issues of confidentiality. 

In general, opinions on this issue reflect on the useful- 
ness of categorical special education. One criticism of 
providing data separately for different categories of dis- 
ability is that it makes the erroneous implication that 
there are neat distinctions between different categories. 
One justification for separate reporting is that it pro- 
vides data that can be used to itrform policy and pro- 
gramming decisions. Those who aigue against categori- 
cal reporting, particularly at the district or campus level, 
indicate concern that these reports for categories of 
small numbers of students (e.g., those with visual im- 
pairments) will violate confidentiality. There could be 
so few students that they will be readily identifiable. 
These data by category are not currently reported sepa- 
rately in Texas. As reporting requirements change, cat- 
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egorical data should only be considered at a regional 
or state level to be used solely for planning or research 
purposes. 



Reporting Accountability: 

Issue 4. There are concents related to reporting of 
results of students who are not attending their home 
campus. 

Many students with disabilities attend schools other 
than their home school or district of residence. When 
this is the case, there is dispute about whether test re- 
sults should be reported by the home school or the 
school the student attends. The debate is intensified 
when there are differences in curriculum across dis- 
tricts and the district of residence has little or no say in 
the curriculum provided by the district of anendance. 
This issue applies as well to students who are not on 
their home campuses, but are served on another cam- 
pus witlw their districts. 



Reporting Accountability: 

Issue 5. There are questions about whether results, 
particularly regarding students with disabilities, are 
communicated in a way that is clear and easily un- 
derstood. 

Reports of testing results often are misinterpreted. A 
major issue in reporting is making cenain that reports 
include clear information about the diaracteristics of 
the students who participated in the assessment This 
becomes more complicated when smdents with disabili- 
ties are included, ^rrent reports do include informa- 
tion about the numbers of students exempted from 
TAAS. Reports are available on how many students 
with disabilities took TAAS, but these are not part of 
the reports included in the accountatnlity ratings. 



Reporting Assessment: 

Issue I. There is disagreement about whether data 
obudned when students use accommodations or al- 
ternative assessmeius should be separated from data 
obtained under standard assessment procedures. 

This issue is related to the accommodations issue on 
whether data obtained under accommodated assess- 
ment are measures of the same things as data obtained 
under standard test conditions. If the data are compa- 




rable, then one could argue that there is rx> need to sepa- 
rate the results for the two groups. 



Reporting Assessment: 

Issue 2. There is a question about the kind(s) of scores 
(e.g., absolute scores or change in performance over 
time) that should be reported for students with dis- 
abilities. 

TAAS reports for non-special education student results 
typically have focused on both absolute scores of per- 
formance and dianges in performance over time. The 
latter reports contribute to the determination of whether 
a school can receive an award through the Texas Suc- 
cessful Schools Award System. It is argued that in- 
creased participation of students with disabilities in the 
TAAS will disrupt the current examination of perfor- 
mance over time. Thus, it will be important to track 
both absolute scores and changes in performance over 
time for students with disabilities, and to factor these 
scores into consideration when looking at the progress 
in performance of schools over time. 



Implementation Issues 



Rve implonentation issues for the Texas assessment 
and accountability systems were identified by the 
focus group. All are listed here first, then each is 
discussed for clarification. 



1 . People do not want to have students 
with disabilities in assessment and 
accountabili^ ^sterns when those 
systems are used for high stakes 
purposes. 

2. Attitude is a barrier to implementing 
assessment and accountabili^ 
s^tems that include students with 
disabilities. 

3. There are concerns about the 
resources needed to expand and 
implement the assessment aitd 
accountabili^ systems. 

4. There is concern about the alignment 
between state and federal statutes and 
et^anded assessment and account- 
abiliQr systems. 

5. There is concern that implementing 
an expanded statewide assessment 
and accountabthty system could ^ 
harm to studentt with disabilities, 
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Issue L People do not want to have students with dis- 
abilities in assessment and accountability systems 
when those systems are used for high stakes purposes. 

In some states, including Texas, the outcomes of state- 
wide testing are used to develop a campus report card. 
The report card serves accountability purposes. The 
focus group reported that some districts may not want 
TAAS or ^temative assessment results for students 
with disabilities included, because of a concern that 
this will be used to determine and possibly reduce the 
accountability rating of their campuses. 



Issue 2. Attitude is a barrier to implementing assess- 
ment and accountability systems that include students 
with disabilities. 

Members of the focus group report that a primary bar- 
rier to greater participation of students with disabili- 
ties in state assessments in Ibxas is a negative attitude. 
They indicate that practitioners in the field find the col- 
lection of the data on performance results of students 
with disabilities not only time consuming and difficult, 
but also feel the information collected is not used by 
district and campus decision makers and policymakers. 
The perception is reinforced if available data are ex- 
clude in the process of making decisions at the state 
level. 



Issue 3. There are concerns about the resources 
needed to expand and implement the assessment and 
accountability systems. 

Cost is a concern in tire development and implementa- 
tion of an expanded testing and accountability system. 
Major decisions must be made about the cost (mon- 
etary as well as other resources) versus benefit of ac- 
cortunodations or alternative assessment systems. With 
staffing limitations at the TEA, alternative resources 
need to be included in developmental activities. How- 
ever, it should be noted that a significant amount of 
educational resources support special education stu- 
dents in the public schools. The Texas legislature has 
determined that there needs to be greater accountabil- 
ity for the use of those funds in improving performance 
of students with disabilities. 



Issue 4. There is concern about the alignment be- 
tween state and federal statutes and expanded assess- 
ment and accountability systems. 

State laws, rules, and regulations about assessment and 
accountability systems are ever changing. Senate Bill 
1 requires that the assessihent and accountability sys- 
tems in Texas will expand and change to include stu- 
dents who are currently exempt from state assessments. 
There is concern that there must be safeguards to en- 
sure that any changes do not inadvertently conflict with 
federal nondiscrimination statutes and regulations. 



Issue 5. There is concern that implementing an ex- 
panded statewide assessment and accountability sys- 
tem could do harm to students with disabilities. 

Some parents in Tbxas, especially parents of students 
with severe disabilities, do not want their children ex- 
posed to statewide assessments. It is thought that the 
lEP is intended to take care of the charting of progress 
of these students toward accomplishment of lEP ob- 
jectives, accounting for the results of their educational 
experiences. Other parents do want their children to 
participate in statewide assessments, in order for them 
to experience testing situations and be a part of the ac- 
countability system. Both parents and educators have 
expressed concern about the potential negative impact 
on students over the continued use of the TAAS, ad- 
ministered with or without modificadons, in the absence 
of more appropriate options. 



ASSUMPTIONS UNDERLYING 
AN ACTION PLAN FOR TEXAS 

N ine assumptions that underlie the recom- 
mended action plan for Texas were identified 
by the focus group. Five of the assumptions 
relate primarily to the accountability system and four 
assumptions relate primarily to assessments. The as- 
sumptions are listed here, then discussed below. 

Accountability 

1 . All students should be included in 
one comprehensive accountibility 
and lining system to ensure ^at 
the mission, {joals, and objectives of 
public education are met. 
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2. An accountability system should be 
fair and recognize tne diversity of 
students m lexas* school population. 

3. A comprehensive accountability 
system should be subject to continu- 
ous improvement while ensuring 
longitudinal consistency. 

4. When students with disabilities 
participate In a state accountability 
system* there will be greater focus on 
improving results, and expectations 
for their pmormance will Increase. 

5. The successful implementation of an 
expanded accountwility and 
assessment system is directly 
dependent on the professional 
development supi^rting it. 



Assessment Assumptions 



1. It will be necessary to provide some 
students with disabilities with 
reasonable accommodations so they 
can participate in assessments. 

2. A small percentage of students with 
disabilities (esproially those with 
significant disabilities or those in a 
different curriculum) need alternative 
assessment procedures. 

3. It will be necessary to provide 
alternative assessments for students 
whose participation in general state 
assessments is not appropriate. 

4. An expanded assessment system that 
include smdents wifii di$ai>ilities 
must con^ly with federal and state 
nondiscrimination regulations. 



Accountability Assumption I. 

An students should be included in one comprehen- 
sive accountability and reporting system to ensure that 
the mission, goals, and objectives of public education 
are met 

The mission, goals, and objectives of public education 
in Texas are for all students in the system. We cannot 
know whedier these are being met if the performance 
of only part of the student population is reported. This 
is true whether an educational system adopts an inclu- 
sive philosophy or not. By including reports on the 
performance of only part of the population, we get in- 
accurate information, especially if there are differences 
among educational units in the extent of participation. 
Since the passage of Public Law 94-142, access to a 
free appropriate public education has been the right of 
every child with a disability. It is difficult, at best, to 



ensure that the purpose of this law is being met unless 
there is a comprehensive accountability system for the 
results of education for all students. 



Accountability Assumption 2. 

An accountability system should be fair and recog- 
nize the diversity of students in Texas* school popula- 
tion. 

Increasingly, students in today’s Texas public schools 
are becoming more diverse in their characteristics. The 
APA Standards for Tests and Assessments reinforces 
the importance of recognizing the diversion of students 
in today’s schools when assessments are developed, to 
reduce the possible introduction of bias. If an account- 
ability system is not fair it will, over time, become in- 
creasingly less appropriate for greater numbers of stu- 
dents. An unfair system, however, is inappropriate for 
any student. 



Accountability Assumption 3. A comprehensive ac- 
countability system should be subject to continuous 
improvement while ensuring longitudinal consistency. 

Over time, there will be major advances in assesanent 
technology. The Texas accountability system must be 
dynamic (itmust allow for revisions). Atthe same time, 
trends and comparisons are important. The balance be- 
tween continuous improvement of an accountability 
system and stability for longitudinal comparisons is a 
tenuous one at best. Still, it is important to continually 
address this issue, and to determine when decirions need 
to tip the balance one way or the other. 



Accountability Assumption 4. 

When students with disabilities participate in a state 
accountability system, there will be greater focus on 
improving results, and expectations for their perfor- 
mance will increase. 

When an individual is held accountable for certain 
things, those things become more important than those 
for which the individual is not held accountable. Like- 
wise, when district and campus ratings ate based on 
the progress of every student in every classroom, there 
will be greater focus on the learning and progress of all 
students. This is the reasoning behind incentive sys- 
tems like that of the TAAS and the Texas accountabil- 
ity system. All students should count equally in the 
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calculations that are the bases for recognitions and 
awards if all students in the education system are to 
benefit from the intended consequences of an incen- 
tive system. 



Accountability Assumption 5. 

The success^l implementation of an expanded ac- 
countability and assessment system is directly depen- 
dent on the professional development supporting it. 

Like many other innovations and changes in education 
and other domains, the critical stakeholder buy-in and 
support is dependent on the participation of informed 
stakeholders in decision-making. For these things to 
happen, there must be adequate and appropriate pro- 
fessional development. This is true in the area of as- 
sessment and accountability, just as it is in the area of 
instructional techniques. It is also important to involve 
parents along with educators in this professional de- 
velopment Gopd evidence of the importance of pro- 
fessional development comes from recent events in Brit- 
ain, where teachers who did not understand the assess- 
ment system and were not adequately trained about it 
were successful in overturning the implementation of 
the system. 



Assessment Assumption 1. 

It will be necessary to provide some students with dis- 
abilities with reasonable accommodations so they can 
participate in assessment. 

Just as some students need accommodations to partici- 
pate in instruction, sO do some students need appropri- 
ate accommodations to participate in state assessments 
in Texas. This notion Im been supported for some time 
by most states, and recently, by the national education 
data collection system. It is not clear how many stu- 
dents may need accommodations. It has been estimated 
that approximately 85% of students with disabilities 
could appropriately participate in regular assessments, 
either with or without accommodations. The frequency 
with which accommodations have been implemented 
in each state is unknown. In a follow-up study of ex- 
clusion from NAEP, the National Academy of Educa- 
tion (in press) found that approximately 85% of sm- 
dents with disabilities could be tested with NAEP or a 
comparable assessment. 



Assessment Assumption 2. 

A small percentage of students with disabilities ( aspe- 
ciaUy those with signfficant disabilities or those in a 
different curriculum) need alternative assessment 
procedures. 

It is generally recognized that some students in Texas 
schools have disabilities that are so severe that drey 
cannot participate in the regular assessment, but need 
an alternative assessment instead. In Kentucky, where 
the accountability and assessment programs were de- 
veloped simultaneously in the massive court-ordered 
educational refomi, it was found that less than 1/2 of 
one percent of all students needed an alternative as- 
sessment. This probably translates to less than 20% of 
students with disabilities, much below the average of 
50% of students with disabilities typically excluded 
from statewide assessments. 



Assessment Assumption 3. 

It will be necessary to provide alternative assessments 
for students whose participation in general state as- 
sessments is not appropriate. 

It will take time to develop alternative assessments. It 
is best to develop them over time, with adequate field 
testing. Among some of the considerations for under- 
taking the development of an alternative assessment 
are: 

• What are the criteria by which a student will be 
allowed to participate in the alternative assess- 
ment? 

• Should there be a standard set or state-approved 
list (i.e. comparable to what is done for LEP stu- 
dents in Texas) of alternative assessments? What 
allowance will need to be made for students with 
disabilities that preclude the use of standard as- 
sessments (e.g. portfolios)? 

• Who will be responsible for determining that a 
student meets the identified criteria for partici- 
pating in the alternative assessment? 

• Should limits be placed on campuses or districts 
for the number or percentage of students allowed 
to take the alternative assessment? 

• What are the implications for graduation and re- 
ceiving a diploma for those students participat- 
ing in the alternative assessment system? 
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• Should the perfoimance standards for the alter- 
native assessment be correlated to TAAS, so that 
the results from the ^o systems can be aggre- 
gated, or will they be kept on separate scales? If 
aggregated, are the scores from both systems 
equally weighted? 

• Who will score the alternative assessment? Does 
there need to be alignment between the scoring 
mbrics for all forms of assessment? 

• Wl the alternative assessment system reflect the 
same educational standards as the regular assess- 
ment system, or will a different set, or a select 
subset, of standards be used? 

• How will alternative assessments be aligned with 
the essential knowledge and skills for the foun- 
dation curriculum? How should this be evalu- 
ated for students under different curricular pro- 
grams (e.g. basic life skills, community-based 
instruction)? 

• How is progress, as indicated on the Individual 
Education^ Plan, related to an alternative assess- 
ment system? Does it play a role in measuring 
educational success for this subset of students? 
How will the alternative assessments be incor- 
porated into the state’s Results-Based Monitor- 
ing System? 



Assessment Assumption 4. 

An expanded assessment system that includes students 
with disabilities must comply with federal and state 
nondiscrimination regulations. 

At least two Federal ' ,rvs probably have an impact on 
how students with disabilities are treated in a statewide 
assessment: Section 504 of the Rehabilitation Act of 
1973 and the Americans with Disabilities Act (ADa, 
Public Law 101-336). Recent federal legislation for 
educational reform (Goals 2000), elementary and sec- 
ondary education (Improving America’s Schools Act), 
and transition to work (School to Work Opportunities 
Act) support the tenets in Section 504 and ADA. The 
Individuals with Disabilities Education Act (IDEA) now 
being considered for reauthorization requires partici- 
pation of students with disabilities in statewide assess- 
ments. Furthermore, in Texas the new requirements in 
the Texas Education Code will take precedence in en- 
suring that an expanded assessment system is consid- 
ered. 



AN ACTION PLAN FOR TEXAS 

F ocus group members worked in groups, and so- 
licited input from their constituents throughout 
the state on possible actions to take in Texas to- 
ward the goal of developing a comprehensive assess- 
ment and accountability system that includes students 
with disabilities. In generating the action plan, the fo- 
cus group first addressed each issue individually, giv- 
ing consideration to what could be done immediately, 
what needed to be done in the future, ard what were 
the research needs. AU recommendations then were 
considered together so that redundancies could be elimi- 
nated. After actions were identified by issue area (par- 
ticipation, accommodation, reporting, implementation), 
all identified strategies were categorized into one of 
three components: networking, research, and devel- 
opment. The development strategies were further sub- 
divided into assessment, policy, reporting, and train- 
ing. The detailed action plans are on the pages that 
follow, with information provided for each strategy on 
the rationale for the strategy, suggested approaches that 
might be taken, where responsibilities might be placed, 
possible products, and a suggested timeline. A sepa- 
rate list is included for resource contact persons for 
agencies or organizations recommended for collabora- 
tive work. Below is an outline listing of the strategies 
included in the action plan: 



Networking 



• Annually update information on other 
states’ guidelines for participation, 
accommodations, and reporting. (Nl) 

• Track finding of legal cases regarding 
issues in participation in assessments 
and use cif testing accommodations. 

(N2) 

• Track ongoing sute and federal research 
on issues on pa^cipadon, accommoda- 
tion. and reporting of the performance 
of students with disabilities in state and 
national assessments. (N3) 

• Track development and modification of 
participation and accommodation 
guidelmes at the national level. (N4) 

• Maintain relationships with and use 
established links with sute education 
agency personnel in other states to 
address assessment issues. (N5) 




v7D 



Including Students with Disabilities in Statewide Assessment and Accountability Systems: A Study of the Issues 



Research 



• Conduct an assessment study of students 
with disabilities who are exempted from 
TAAS during the Spring 1996 adminis- 
tration. (Rl> 



Annually review the unintended 
consequences of including students with 
disabilities in state assessment and 
accountability systems (e.g., retention in 
grade, over-referral for testing, 
dropouts). (R2) 



Development: 

Assessment 

• Build an alternative assessment system 
for students with disabilities who cannot 
participate in the standard state 
assessment, even with modifications. 
(DAI) 

• Continue to include students with 
disabilities in the development of any 
hiture state assessments and any 
revisionsofthecunentTAAS. (DA2) 

• Utilize a panel of practitioners who 
serve on a continuing basis as an 
advisory ^oup to many of the strategies 
in this action plan. (DAB) 



Development: 

Policy 

• Develm guidelines for deciding the 
kind of assessment (standard, modified, 
or alternative sute assessment) to be 
taken by students with disabilities, and 
track adherence to the guidelines. 

(DPI) 

• Review existing Texas accommodations 
guidelines; modify these as necessary, 
and track adherence to the guidelines. 

(DP2) 



Development: 

Reporting 



• Phase in a requirement to report results 
for all students in district or state 
assessment/accountability reports. 
Results should be rmrtM for all 
students with disabilities. Results should 
be coded by category, but results should 
never be rmrted by categc^ for state 
accountabiuty rep^. Regional and 
state data by dissbility may be com- 
pleted for program research purposes 
only. (DR2) 

• Assign responsilnlity for reporting 
scores to the student's distnct of 
residence and home campus. (DR3) 

• Report both absolute scores aiKl change 
in performance scores for all students. 
(DR4) 

• Phase in a requirement to report on the 
progre^ of aU students in any rating or 
recognition sj^tem set up for campuses 
or districts. (DR5) 

• Develop descriptions of the reporting 
system (specified in second reporting 
strategy) for use by the media, parents, 
and school district personnel. (DR6) 



Development: 

Training 

• Provide training or continuing education 
to ARD commiuee members, including 
parents, in making decisions about 
participation of stiKients with disabilities 
m assessments, appropriate accommoda- 
tions, and assessment options. (DTI) 

• Provide training on data reporting, 
analysis, and interpretation for campi^ 
district improvement planning. (DT2) 



A crosswalk of critical issues and action plan strate- 
gies is provided in Exhibit 5 to demonstrate that 
every strategy included in the Recommended Action 
Plan addresses at least one of the issues that was 
identiHed for Texas, and that every issue identified 
for Texas has been addressed by at least one strategy 
in the action plan. A depiction of possible timelines 
suggested in the table is provided. 



• Determine how results for students with 
disabilities will be included in the 
assessment component of the Texas 
accountability system, (including 
repotting of the numbm of students 
who were exempted from assessments) 
and in all published or unpublished 
reports of results. (DRl) 
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SUMMARY AND 
IMPLICATIONS OF THE 
RECOMMENDED 
ACTION PLAN 

I t is recognized many of the recommended strate- 
gies and {^roaches in the action plan will require 
significant investments. To develop an alternative 
assessment and to consult with other states already 
working on the issues that Texas must address will be 
very time intensive. Funds will be needed to conduct 
research, and personnel time will be required to over- 
see activities at the state level and at the district level. 
Additional resources (consultants, scoring assistance, 
time, etc.) will have to be considered as well. 

Required Resources 

Networking. Most of the networking strategies call 
for tracking of the activities of others and keeping up- 
to-date on developments in the statewide assessment 
of students. It would be necessary for TEA to assign 
specific employees to regularly track designated activi- 
ties and developments, and obtain copies of technical 
reports and other products from the centers and agen- 
cies listed. Collaborating with other states will require 
both personnel time and some investment in collatora- 
tive efforts (e.g., membership inSCASS). At this time, 
Tbxas has applied for memtership in the SCASS. 

Research. Research strategies included in the action 
plan would involve commitment of fiscal resources and 
personnel. The first activity calls for a study of stu- 
dents exempted from TAAS during the spring 1996 
administration. If personnel in the various regions were 
to be used to coordinate the assessment of the students, 
costs could be minimized. The second n search strat- 
egy, an armual study of the unintended consequences 
of assessment systems, would require formation of a 
group and some member of the group conducting an 
armual survey, as well as costs for materials, postage, 
and additional analyses. 

Devdooment. The development strategies call largely 
for the development of an alternative assessment sys- 
tem that includes policies, guidelines, and training. It 
is anticipated that development of the guidelines would 
need to be an agency-wide collaborative effort and 
would need to include a system to monitor implemen- 
tation. While this is clearly the most costly develop- 
ment strategy, this has been done by other states, and it 



will be worth investigating piggy-backing on their ef- 
forts, or working collaboratively with other states on 
the development. 

Training will also require some initial and continued 
investment. Without training on decision guidelines 
and policies, it is anticipated that districts and home 
campuses will continue to struggle with implementa- 
tion of assessment practices. \^th such guidelines and 
the training necessary to implement them, it is antici- 
pated that significant advances could be made in the 
successful implementation of assessment systems in 
which all students participate. 



Return on Investment 

R eturn on investment is not necessarily best rep- 
resented by a breakdown of the benefit of each 
type of strategy. The most important return, of 
course, is that systematically implementing the recom- 
mended action plan will meet the mandate of the Texas 
Education Code (Senate Bill 1, Section 39.027). By 
implication, it will make the Tbxas accountability sys- 
tem one that includes students with disabilities in per- 
formance measures as well as in the education process 
measures of attendance and dropout rates. 

Networking . The benefit of tracking exercises is that 
TEA personnel would be able to stay aware of and profit 
from activities in other states and agencies. The ben- 
efit toTbxas is significant. TEA personnel would profit 
from collaborative problem solving with other state 
education agencies. The cost of unilateral problem solv- 
ing would be avoided, and Texas would profit from 
access to the results of studies carried out in other states. 

Research. Proposed research activities are benefi- 
cial because they feed directly into decisions that Texas 
needs to make about its assessment and accountability 
systems. 

Development. It is in the development activities 
(based on networking and research) that the major re- 
turn on investment is evident First and foremost, the 
development of an alternative assessment system meets 
the intent of Senate Bill 1. Furthermore, policy, re- 
potting, and training strategies ensure the successful 
implementation of the revised accountability system. 
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Additional Determinations 

T he 74th legislature shifted the focus of the Texas 
public school system from a concentration on 
mandates to reliance on knowledge, planning, 
and accountability (Draft Long-Range Plan for Public 
Education,1996-2000, State Board of Education, Sep- 
tember, 1995). One of the requirements of the new 
Senate Bill 1 (Section 39.027c) states that the perfor- 
mance of students who are currently exempt from state 
assessments must not only be measured under an as- 
sessment system, but also must be “included in the aca- 
demic excellence indicator system (Section 39.051), 
the campus report card (Section 39.052), and the per- 
formance report (Section 39.053)” of tb i accountabil- 
ity system. 

Since data for students with disabilities are included 
in a limited manner for the AEIS, the School Report 
Card and the Performance Report, interpretation will 
need to be made as to what additional data are to be 
included in these reports and how these results are to 
be used. Determination will need to be made regard- 
ing the intent of the Senate Bill 1 requirements in Sec- 
tion 39.027c as to the following: 

1 . What additional data for students with disabilities 
are to be included in the AEIS, the School Report 
Card, and the Performance Report that are not cur- 
rently included as part of the reporting system? 

2. How are assessment results for students with dis- 
abilities to be reported? 

• For those students who take the standard TAAS, 
will results be aggregated into the current non- 
special education student report? 



• For those students who take the TAAS with 
modifications, will results be aggregated or 
reported separately? 

• For those students who take alternative assess- 
ments, will those data appear as a separate 
report? 

3. How are the assessment results for students with 
disabilities to be used in the accountability report- 
ing system? 

• If the performance results are to be included 
in AEIS, is that to be done as a separate re- 
port as it is now or only as profile informa- 
tion? 

• Are the performance results intended to be 
used along with the results of non-special 
education students within the AEIS as the 
basis for accountability ratings and 
rewards? 

As Texas continues to focus on public school excel- 
lence, equity, and efficiency through greater account- 
ability, educational results for students with disabili- 
ties will also be part of the system. There is now an 
unprecedented opportunity to integrate current reform 
efforts with the development of new options. Includ- 
ing students with disabilities in statewide assessment 
and accountability systems should ensure the success 
and progress of aU students served by the public 
school system in Texas. 
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EXHIBIT 1 



Sources of Information for Focus Oroup 



Initial Resources 

When the focus group started its efforts, it began with a set of information, including a briefing paper, 
that was drawn from several previous efforts to identify some of the national issues related to the 
participation of students with disabilities in assessment, accountability, and testing systems. These 
sources included: 



• Results of the annual surveys (1991 - 1994) of state accountability practices for 
students with disabilities conducted by NCEO. 

• Results of a working session (Chicago, September, 1992) on barriers to putting new 
accountability practices in place, sponsored by NCEO and the National Association 
of State Directors of Special Education (NASDSE), and attended by state assessment 
directors and state directors of special education. 

• Papers on alternative ways to make decisions about participation and accommodation, 
written by experts in assessment and special education, and commissioned by NCEO. 

• Results of a NASDSE Forum working session (August, 1994) on alternative account- 
ability practices. 

• Results of a working session (Washington, DC, March, 1994) of NCEO and the 
National Center for Education Statistics (NCES) on increasing the participation of 
students with disabilities in large-scale national assessments. 

• Results of a working session (Tyson’s Comer, May, 1994) of NCEO and state assess- 
ment personnel, sponsored by NCEO and the Council for Exceptional Children 
(CEC), on developing guidelines for inclusion of students with disabilities in state- 
wide assessments. 

• Contents of the NCEO “Setting State Assessment Guidelines for Students with 
Disabilities: A Study Guide.’’ 

• Proceedings of a NASDSE working session (Salt Lake City, February, 1995) on a 
conceptual model for state accountability systems. 
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Related Documents 

As appropriate, documents related to current national and state refonn efforts were provided to focus 
group members during the course of the project. These included: 

• "Struggling for Standards," Education Week Special Report. April, 1995. 

A user’s guide to the national education standards movement, including the activities of 50 
states. 

• "Outcomes: Watch Your Language” (Ysseldyke andThurlow, 1994). A clarification of ways 
in which the word "outcomes" is used and why we must be careful in using appropriate terms. 

• "Special Education Testing Study Inconclusive," Education Daily. June, 1995. A review of 
federal exclusion study in New York and the concern for determination of participation rates 
for students with disabilities in state assessments. 

• "Don't Test, Don't Tell," (Zlatos, November 1994). The American School Board Journal. A 
description of "academic redshirting" to define exclusion of students with disabilities from 
state assessments. 

• "Surveying the Landscape of State Education Assessment Programs," Council for Educa- 
tional Development and Research. Includes profiles of state assessment. 

• "High School Graduation Requirements: What's Happening for Students with Disabilities?" 
(Thurlow, Ysseldyke, Anderson; May, 1995). NCEO . Analysis of range of graduation require- 
ments across all states. 

• "A Compilation of States' Guidelines for Accommodations in Assessments for Students with 
Disabilities." (Thurlow, Scott, and Ysseldyke; March, 1995). NCEO . Listing of 38 states’ 
guidelines on accommodations, modifications, and adaptations of assessments for students 
with disabilities. 



Working Reference Materials 

Resource documents directly related to the Texas assessment and accountability systems were 
provided for use by the focus group as reference material for the work of the project. Those in- 
cluded: 

• Accountability Manual 

• Glossary of AEIS 

. • Tfesting Appropriate Students — Tbxas Education Code 

• TAAS Coordinator's Manual: Modifications forTAAS and End-of -Course Exams 

• Excessive Exemptions Study (TEA) 

• Proposed TEC Revisions/74th Texas Legislature/May 1995 

• Alternative Assessment of Students with Languages Other Than English 

• TAAS and End-of-Course Objectives/All Grades Tested 

• TAAS Specifications 

a) 3rd Grade — Reading 

b) Exit Level — Reading, Writing, Math 

• Senate Bill 1 
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EXHIBIT 2 
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ADA 

Americans with Disabilities Act 

AEiS 

Academic Excellence Indicator System 

ARD 

Admissions, Review and Dismissal 

ccsso 

Council of Chief State School Officers 

CEC 

Council for Exceptional Children 

IDEA 

Individuals with Disabilities Education Act 

lEP 

Individual Education Program 

LEP 

Limited English Proficient 

NAEP 

National Assessment of Educational Progress 

NASDSE 

National Association of State Directors of 
Special Education 

NCEO 

National Center on Educational Outcomes 



OERI 

Office of Educational Research and Improvement 

OSEP 

Office of Special Education Programs 

PEIMS 

Public Education Information Management 
System 

RBM 

Results-Based Monitoring 

SCASS 

State Collaborative on Assessment and Student 
Standards 

TAAS 

Texas Assessment of Academic Skills 

TABS 

Texas Assessment of Basic Skills 

TEA 

Texas Education Agency 

TEAMS 

Texas Educational Assessment of Minimum 
Skills 

TSSAS 

Texas Successful Schools Award System 



NCES 

National Center for Education Statistics 
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EXHIBIT 3 



iiiSaM iitv- of TS|f ; 



Absolute Score — an actual test score , which is always an estimate, based on sampling of behaviors or skills, 
of what the test taker knows or can do 

Accommodation — (other terms: adaptation, modiOcation) an alteration in the way that a test is presented 
to or responded to by the person tested; includes a variety of alterations in presentation format, 
response format, setting in which the test is taken, timing or scheduling, as well as other possible 
changes (such as assessment in a different level from the standard) 

Accountability — a systematic method to assure that those inside and outside of the educational system that 
schools are moving in desired directions; commonly included elements are goals, indicators of 
success toward meeting those goals, analysis of data, reporting procedures, and consequences or 
sanctions 

Accountability Rating — a four point scale used to describe the perfonnance of a campus in the Texas 
accountability system based onTAAS perfonnance, dropout rate, and attendatKe; the four ratings 
are exemplary, recognized, acceptable, and low-performing. Schools earning either of the first two 
ratings are eligible for the Texas successful Schools Award System (TSSAS). Acceptable schools 
may be eligible for awards if they showed signiOcant gains 

Accreditation Status — a four point scale used to describe the performance of a district in the Ibxas ac- 
countability system based on TAAS performance, dropout rate, and attendance rate; ratings are 
exemplary, recognized, accredited, and accredited, warned (campuses in districts with this last rat- 
ing cannot receive a TSSAS award) 

Adaptation — (other terms: accommodation, modification) an alteration in the way that a test is presented to, 
or responded to by, the person tested; includes a variety of alterations in presentation format, re- 
sponse format, setting in which the test is taken, timing or scheduling, as well as other possible 
changes (such as assessment in a different level from the standard) 

Alternative (Alternate) Assessment — an assessment that is different from one typically used; a differ- 
ent form of a test 

ARD Committee — in Texas, a terni for the Admissions, Review, and Dismissal Committee, which performs 
functions similar to those of an Individualized Education Program (lEP) team; in Texas, this team 
determines whether a student panicipates in the TAAS, and what modifications the student may use 
during assessment 

Assessment — the process of collecting data for the purpose of making decisions; in Texas this term usually 
refers to testing 

Attendance — the total number of days students were present during the school year divided by the total 
number of days students were in membership during the same school year 
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Change Score — (other term: difference score) represents the difference between two scores; term implies 
that the difference represents a true change in performance; technically, additional considerations 
must be made to evaluate the “significance” of a difference, including the reliability of the differ- 
ence, the rarity of the difference, and the psychological meaningfiilness of the difference 

Criterion Referenced Test — test that measures a person’s development of particular skills in terms of 
absolute levels of mastery 

Dropout Rate — for the Texas accountability system, the dropout rate is the number of dropouts summed 
across all grades, 7 through 12, divided by the number of students summed across all grades, 7 
through 12. A dropout is defined as a student who is absent from the public school in which the 
student is enrolled for a period of 30 or more consecutive days, who does not hold a high school 
diploma or the equivalent, and whose attendance within that period at another public school or a 
private or parochial school cannot be evidenced 

Exclusion from Testing — the act of barring someone from participation in an assessment program 

Exemption from Testing — the act of releasing someone from a requirement to which others are held 

Exit Exam — a test that must be taken and passed in order for a student to successfully leave some part of 
schooling, such as middle school (middle school exit exam); this term most often is used to refer to 
a high school graduation exam 

Graduation Exam — a test that must be taken and passed in order for a student to earn a high school diploma 

High Stakes Testing — assessment tliat has significant consequences for an individual or school system; 

for example, a high school graduation exam that is used to determine whether a student receives a 
diploma is a high stakes test for the student, whereas a benchmark exam that determines whether a 
school receives a financial reward is a high stakes test for the school 

Large Scale Assessment — assessment of groups undertaken to describe a district, state, or nation 

Minimum Competency Test — a test designed to determine whether a student has successfully mastered 
skills assumed to be the minimum possible to be considered as having gained necessary skills and 
knowledge in school 

Modification — (other terms; accommodation, modification) an alteration in the way that a test is presented 
to or responded to by the person tested; includes a variety of alterations in presentation format, 
response format, setting in which the test is taken, timing or scheduling, as well as other possible 
changes (such as assessment in a different level from the standard) 

Norm Referenced Test — test that compares an individual’s performance to that of his or her peers; these 
tests are designed to discriminate among the performances of a number of individuals and to inter- 
pret how one person’s performance compares to that of other individuals with similar characteris- 
tics 

Performance Assessment — an exam that requires the student to create an answer or a product rather 
than simply filling in a blank or select a correct answer from a list; the task performed by the 
student is intended to be authentic 
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Portfolio Assossmont — a type of performance assessment that uses a file or folder to contain collec- 
tions of a student’s work: the products typically depict the range of skills the student has or the 
improvement in a student’s skill(s) over time 

Promotion Exam — a test used to determine that a student has successfully mastered material to move to 
the next level of education 

Reiiabiiity — the extent to which the same score is expected when (a) a student is measured at two different 
times, (b) two different samples of items are used, or (c) two different scorers judge performance 

Standardized Test — test for which scores have been transformed so that the mean and standard devia- 
tion take predetermined values 

Technical Adequacy — the goodness of certain characteristics of a test considered to be important, 
including standardization sample, reliability, and validity 

Test Bias — the tendency of a test to not measure what it is said to measure because of systematic influ- 
ences from inappropriate sources, such as ethnic background, gender, and disability 

Texas Assessment of Academic Skills — a criterion-referenced test that measures student achieve- 
ment in reading and mathematics at grades 3 through 9 and 10, and writing at grades 4, g, and 10. 
The tests are given in the spring of each year 

Texas Successful Schools Award System — incentive system to reward schools that exhibit high 
performance or the greatest progress in achieving state educational goals; in 1994, $5 million in 
awards were shared by nearly one thousand schools 

Validity — the extent to which a test measures what it is said to measure; there are several types of validity 
(content, construct, criterion), depending on the procedure used to demonstrate what the test 
measures 
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EXHIBIT 4 




This bibliography provides information on sources cited in dtis paper, as well as on 
other sources that are relevant to the topic of including students with disabilities in 
statewide assessment and accountability systems. 



Allington, R.L., & McGill-Franzen, A. (1992). Unintended effects of educational reform in New York. 
Educational Policy. 6. (4), 397*414. 

This aiticle reports a significant increase in retention and identification of students for special education services 
during a period of increased high-stakes assessment from 1978 to 1989. 

Bell, G. (1994). The test of testina; Making ao’^ropriate and ethical c hoices in assessment. Oak Brook, IL: 
North Central Regional Educational Laboratory. 

This docum^t addresses a myriad of topics related to choices that need to be made in relation to testing. In 
addition to general ethical assessment responsibilities, it addresses the selection and development of testing 
programs, preparing students for an assessment, administering the test, and interpretation and use of test results. 
Several issues are addressed in each of these areas. 

Brauen, M., O’Reilly, F., & Moore, M. (1994). Issues and options in outcomes-hased acrniintahilitv for 
students with disabilities . Rockville, MD: WESTAT. 

This document provides a framework for creating an outcomes-based accountability system that includes students 
with disabilities. It addresses issues and options for four decisions: (1) selecting outCOTies, (2) establishing 
perfonnance standards, (3) identifying assessment strategies, and (4) identifying accountable parties. 

Briand, X. (1995, May 8). “National survey shows states exclude disabled from tests.” Education nailv. 28 

( 88 ), 1 , 3 . 



This artcle describes the results of a survey of state directors of special education in 37 states. In this description. 
Texas is reported to include 42 percent of its students with disabilities in the Texas Assessment of Academic Skills 
(TAAS). 

Clark, C. (1992). Accountability systems; A review of t he literature. Texas Center for Educational Re- 
search. (This paper also appears as Chapter II in Volume II of A new accountability system for Texas nnhllc 
schools by the Educational Economic Policy Center, State of Texas.) 

This repoit includes definitions of accountability and information on designing an accountability system. 

Houser, J. (1994). Assessing students with disa bilities and limited English nrofiriencv tWoricmp Pnp»r oc. 
13). Washington, DC: U. S. Department of Education, Office of Educational Research and Improvement. 

"Hiis paper presents a summary of issues that have been addressed related to the inclusion of students with disabili- 
ties and students with limited English proHciency in the National Assessment of Educational Progress (NAEP. 
Major topics include: data validity and current policy; current status; data validity and alternative assessment; and 
next steps. 
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dimhilifi^s in national data rnllt»gtinn nroprams . (Technical Report 2). Minneapolis, MN: National Center on 
Educational Outcomes. 

This document presents an analysis of the degree to which individuals with disabilities are involved in national and state 
data collection programs. Recommendations for increasing the participation of individuals with disabilities are provided. 

McGrew, K.S., Thurlow, M.L., & Spiegel, A.N. (1993). The exclusion of students with disabilities in national data 
collection programs. Educational Evaluation and Policy Analysis. IS. 339*352. 

This article reports on the extent to which students with disabilities are excluded from our national data collection 
programs. Included are data collection programs in the Department of Education, Department of Health and Human 
Services, Department of Commerce, and the National Science Foundation. 

National Academy of Education. (1993). The trial state assessment: Prospects and realities (Third Report of the 
National Academy of Education Panel on the Evaluation of the NAEPlYial State Assessment: 1992 Drial State 
Assessment). Stanford, CA: American Institutes for Research. 

This document provides a comprehensive analysis of the state level administration and reporting of NAEP. Among the 
topics covered are the exclusion of students on Individualized Education Programs, induing charts showing the rates of 
inclusion and exclusion by state. 

NCEO. (1993). State special education outcomes 1992. Minneapolis, MN: National Center on Educational 
Outcomes. 

This is an annual state report prepared by the National Center on Educational Outcomes. It reports on state activities in 
assessing the results of education for students with disabilities. 

NCEO. (1995). State special education outcomes 1994 . Minneapolis, MN: National Center on Educational 
Outcomes. 

This is one of the annual state reports prepared by the National Center on Educational Outcomes. It focuses on state 
activities in assessing the results of education for students with disabilities, as well as including a special report on the 
status of students with disabilities in relation to Goals 2000 activities. 

North Central Regional Education il Laboratory. (1994). State student assessment programs database 1993*1994. 
Oak Brook, IL: NCREL. 

This document presents the results of a survey of state assessment personnel that is conducted annually. It provides 
information on content areas covered, grade levels assessed, types of assessments, and so on for many additional 
variables. 

OmceofTechnology Assessment. (1992). Testing in American schools; Asking the right questions. Washington, 
DC: U.S. Government Printing Office. 

This document examines technological and institutional aspects of educational testing. It provides a broad view of a 
range of issues related to testing and accountability. 

Phillips, S.E. (1994). Legal implications of hlgh*stakes asses.sment: What states should know (Regional Policy 
Information Center Report). Oak Brook, IL: North Central Regional Educational Laboratory. 

This report was written to “help state and national education policymakers avoid legal challenges to their student 
assessment programs.” It does so by explaining the relevant legal and psychometric issues. 

Thurlow, M.L., Scott, D.L., & Ysseldyke, J.E. (1995). Compilation of states* guidelines for including students 
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disabilities in assessments ^Synthesis Rgpnrt 17). Minneapolis, MN: National Center on Educational Outcomes. 

This lepoit compiles the written laws, regulations, and guidelines that states have on the participation of students with 
disabilities in statewide assessments and includes a summary of the major themes and trends. 

Thurlow, M.L., Scott, D.L., & Ysseldyke, J.E. (1995). Compilation of states* guidelines for accommodations in 
assessments for students with disabilities (Synthesis Report 18). Minneapolis, MN: National Center on Educa- 
tional Outcomes. 

This report compiles the written laws, regulations, and guidelines that states have about the use of accommodations in 
statewide assessments. It includes a summary of the major themes and trends in the written accommodations guidelines. 

Thurlow, M.L., Shriner, J., & Ysseldyke, J.E. (1994). Students with disabilities in the context of educational 
reform based on statewide educational assessments. Paper presented at the annual meeting of the American 
Educational Research Association, New Orleans. 

This is a paper that was presented at AERA to summarize the status of statewide assessments in terms of the participation 
of students with disabilities, the accommodations that are allowed, and the nature of written guidelines. 

Ysseldyke, J.E., Christenson, S.L., & Thurlow, M.L. (1993). Student learning in ronfext mnd«»l nrniwr (Final 
Report). Minneapolis, MN: Department of Educational Psychology. 

This final report of a federally funded project describes a model intervention to support all students with disabilities in 
general education classrooms. It addresses the difficulties in bringing about change in schools, and in generating 
responsibility for students with disabilities among ail educators. 

Ysseldyke, J.E., & Thurlow, M.L. (1994). Guidelinesfor inclus ion of students with disabilities in large-scale 
asstssmcnts (Policy Directions No. 1). Minneapolis, MN: National Center on Educational Outcomes. 

This policy report explains ways to include students with disabilities in large-scale assessments, use possible accommo- 
dations and adaptations, and monitor how well the intent of the guidelines is followed. Included are recommendations 
and a list of resources. 

Ysseldyke, J.E., Thurlow, M.L., & Anderson, C.L. (1995). High school graduation requirements: What*s happen. 
ing for students with dlsahilitiiKi? rSvnth«.sk Report 20). Minneapolis, MN: National Center on Educational 
Outcomes. 

This report summarizes and analyzes current state graduation requirements and how they are applied to students with 
disabilities. Variability from one state to another is demonstrated. 

Ysseldyke, J.E., Thurlow, M.L., & Geenen, K. (1994). Implementing of alternative methods for making #d»ra. 
tional accountability decisions for students with disabilities Synthesis R«.pnrt liv Minneapolis, MN: National 
Center on Educational Outcomes. 

This report on a seminar of state special education directors and state assessment coordinators from six states examines 
the challenges of collecting data to make accountability decisions for students with disabilities. Recommendations for 
future practice are provided. 

Ysseldyke, J.E., Thurlow, M.L., & Shriner, J.G. (1994). Students with disabilities and ediiratinnal standards: 
Recommendations for policy and practice (NCRQ Policy nir«.r«inn<! Minneapolis, MN: National Center on 
Educational Outcomes. 

Fbur kinds of standards are explained in this report along with the merits and limitations for three alternative per^- 
tives on setting standards and the issues educators face when setting appropriate standards for all students. Also included 
are recommendations for policy and practice for both content standards and performance standards. 
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Ziatos, B. (1994). Don’t test, don’t tell. The Americ an School Board tournal. 181 (11). 24-33. 

This article describes the “academic red-shirting” phenomenon, suggesting that this and similar practices skews the way 
we rank our schools. It is suggested that some schools succumb to a temptation to make their scores look artificially 
good, resulting in children being left out of tests. 
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EXHIBIT 5 



Crosswalk and Action Plan $trateglaa 
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EXHIBIT 6 
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EXHIBIT 7 

States^^lf*Neported Oecisfoo Buies for the Participation of 
Students with Disabilities in Statewide Assessments 



/ // / / / 

• : T" 





• • • ' 


Alaska 


• • • 


Arizona 


• • 


Aiiouuas 


• • 


California 


• 


Colorado 


• 


Connccticttt 


• 


Delaware 


• • • • 


Florida 


• 


Georgia 


• 


Hawaii 


• 


Idaho 


• • 


Illinois 


* • 




• • 


Iowa 


• • • 


Kansas 


^ • 


Kcntuclgr 


j 

• 


Louisiana 


® • 


Maine 


• • • 


MaiTland 


• 


Massachusetts 


• • • • 


Mkh^an 


• ■ i 


Minnesota 


• • • 


MissbsiDpt 


• • • 


Missouri 


• • • 


Montana 


• • 


Nebraska 




Nevada 


• 


New Hampshire 




New JerMv 


• • • 
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/ / A ./ 

STATE / i 



New Mexico 
New York 
North CaroUiui 


• • 

• 

% 

• • 


North DokoU 
Ohio 

Oklahoaui 


• • • • 
• 


Orc(0B 
Pcims^aiiio 
Rhode IsUnd 


• • • 

• • 

• • • • 


South Carolina 
South Dakota 
Tennessee 


• 

• 

• 


Texas 

Utah 

Vermont 


• • • • • 
• 

• 


Virfinia 

Washinfton 

WestVirKinia 


• • • 

• • 
• • • • • 


Wisconsin 

Wyoming 


• • 
• • 


Am Samoa 

BIA 

DC 


• • • • 

• 

• • • • 


Guam 

CNMI 

RMI 


• 


Palau 

Puerto Rico 
USVI 


• 

• 

• 
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EXHIBIT 8 






/////A / // ////// 



STATE 


Accommodation Typo 


ARamalo Praacniation 


AUsmatanaaponaa 


AlalMuna 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 




Alaska 




✓ 




✓ 




✓ 




✓ 


✓ 




✓ 


Arizona 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Ariumsas 


✓ 


✓ 


✓ 


✓ 




/ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


California 


✓ 


✓ 


✓ 


Cokwado 


✓ 


✓ 








✓ 




Connrrikot 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 






✓ 
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✓ 




✓ 




✓ 
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✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


/ 


✓ 


Gooriia 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


HawaU 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


Idaho 


✓ 


✓ 














✓ 


✓ 




Dlinois 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 




Indiana 


✓ 


✓ 


✓ 


✓ 




✓ 


✓ 




✓ 


✓ 


✓ 


Iowa 








Kansas 


✓ 


✓ 


✓ 


✓ 
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✓ 


✓ 


✓ 


✓ 


✓ 
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✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
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✓ 
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✓ 




✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 


✓ 
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✓ 


✓ 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


✓ 
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✓ 
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✓ 


✓ 
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✓ 
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Appendix A 




Introduction 



R egion IV Education Service Center (ESC) re- 
ceived a six-month grant from the Ihxas Edu- 
cation Agency in April 1995 to facilitate the 
development of : 

a) a critical issues document leading to the inclu- 
sion of students with disabilities in the statewide 
assessment and accountability system, and 
b)a recommended action plan for the Texas Edu- 
cation Agency. 

The issues were studied by a representative statewide 
group of stakeholders who had an interest in examin- 
ing Vocational results for all students. The plan was 
developed in relation to the identified issues, and within 
the context of current educational reform in Texas. 



Goals/Objectives 

T n order to ensure that all issues critical to inclusion 
of students with disabilities were considered, the 
following major goals and objectives forthe project 
were outlined: 

Goal I: To establish a network of support 
among statewide stakeholders in the identifi- 
cation of critical assessment issues. 

Objective 1 : To secure the active participa- 
tion of a representative statewide sample of 
stakeholders in the development of critical is- 
sues. 

Objective 2: To ensure input representative 
of the needs of students with all types of dis- 
abilities, as well as be reflective of the diverse 
characteristics of the state of Texas. 

Goal II: To develop recommendations for the 
implementation of an inclusive accountability sys- 
tem for Texas. 



Objective 1 : To collaboratively work with 
both the Texas Education Agency and the 
stakeholder group to address current issues 
and recommended guidelines for: 

• participation (exclusion versus inclusion) 

• accommodations and adaptations 

• reporting results 

• incentives for including students with 
disabilities 

• identification and reduction of barriers 

Objective 2: To develop a working docu- 
ment for dissemination which outlines a rec- 
ommended action plan for the state to ap- 
proach the identified issues. 



Methods/Activities 

T he Region IV ESC staff utilized a facilita- 
tion approach to the proposed project Dr. 
James Ysseldyke and Dr. Martha Thurlow of 
the National Center on Educational Outcomes for 
Students with Disabilities (NCEO) at the Urriversity 
of Minnesota agreed to a formal collaborative effort 
with this project The Region IV ESC staff, consist- 
ing of representatives of both general and special edu- 
cation, served as facilitators of the project. Continu- 
ing collaboration with the Texas iVucation Agency 
staff was critical as the Region IV ESC staff under- 
took the project activities for each identified goal and 
resulting objectives: 

Goal I: Establish support network of statewide 
stakeholders 

Objective 1 : Secure representative state- 
wide sample of stakeholders. 

Activities: 

l.a. All potential stakeholders groups statewide 
were contacted indicating the purpose of the pro- 
posed project focus group to be selected, goals/ 
ol^ectives/activities to be accomplished, time 
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commitment required, and timelines to be met. Ad- 
vocacy groups, professional oiganizations, and 
other t^propriate parties were asked to nominate 
individuals who could best articulate their perspec- 
tive as representative stakeholders for the project 
focus group. 

• Each representative was selected to participate, 
and was required to have regular communication 
with their organization/constituency to communi- 
cate the process of the project focus group as the 
work progressed. 

• Organizations invited to nominate representatives 
for the project focus group included: 

Texas Council of Administrators of Special 
Education 

Texas Association for Learning Disabilities 
Texas Council for Exceptional Children 
Texas Education Agency - Divisions for Account- 
ability and Special l^ucation Programs (in- 
cluding representatives for low 
incidence populations) 

Governor’s Continuing Advisory Committee for 
Special Education 
Institutions of Higher Education 
Texas Elementary Principals and Supervisors 
Association 

Texas Association of Secondary School 
Principals* 

Texas Mental Health/Mental Retardation 
Authority 

Texas Association of School Administrators 
Texas Association of School Boards 
Texas Association of Supervisors and Curricu- 
lum Directors 
Texas School for the Deaf 
Texas School for the Blind and Visually 
Impaired* 

Tfexas Planning Council for Developmen- 
tal Disabilities 

• Organization notable to identify representative 
who could commit to the compressed time sched- 
ule of the project. 

lb. Alternative avenues for input were established 
for the following entities: 

Advocacy Inc. 

The ARC of Texas 

Texas Planning Council for Developmental 
Disabilities 



Regular communication, meetings, and/or opportuni- 
ties for input of information and feedback were pro- 
vided to these advocacy groups. 

Ongoing meetings were conducted at the Texas Edu- 
cation Agency with personnel from special education; 
student assessment; accountability; policy, plaruiing, 
and evaluation; and legal to review the progress of 
the project focus group, discuss issues, and receive 
input tom TEA staff. 

Objective 2: To ensure representative input 
through project focus group 

Activities 

2a. In consultation with the Texas Education 
Agency, Region IV ESC ensured that all groups 
contacted included representation of the interests 
of aU disability groups through the inclusion of 
professional organizations as well as advocacy 
groups. 

2b. Ouster representation (e.g. multiple ESC ser- 
vice areas) tom the major geographic areas of 
the state was used to attempt to coincide with the 
school population density within each section of 
the state. An attempt was made to ensure that 
each area of the state had no greater representa- 
tion of the project focus group than the percent- 
age of the school population of the state repre- 
sented by that area (e.g. Region IV ESC repre- 
sents a school population of approximately 20- 
25% of Texas). 

2c. The gender and ethnic make-up of the project 
focus group was analyzed for diversity represen- 
tative of the school population in Texas, liiis was 
accomplished during the nomination process and 
was stated as part of the nomination criteria. 



GOAL II: Develop recommendations for inclu- 
sive accountability system 

Objective 1: Address current issues and rec- 
ommended guidelines 

Activities: 

la. Region IV ESC staff worked with Drs. 
Y sseldyke and Thuriow to prepare a draft of criti- 
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cal issues in statewide assessment of students with 
disabilities. The NCEO consultants met regularly 
with Region IV ESC staff to determine the frame- 
work for the initial discussion draft, to refine the 
issues specific to Texas, to evaluate the progress 
ofproject activities, and to prepare the resulting 
document for disseminaticm. 

lb. Region IV ESC personnel held a set ofproject 
focus group meetings to review the identified is- 
sues and determine generalization best fit to the 
Tbxas educational system. Ysseldyke and Thurlow 
met with members of the project focus group for 
an initial 2-day meeting during the first week of 
June 1995. Along with Region IV ESC staff as 
facilitators, the consultants walked the groups 
through a tentative set of issues and discussed ra- 
tionale for the inclusion of each issue. 

l c. The project focus group met as a smdy group 
for three additional meetings during June, July, and 
August to focus on each specific issue. Interim 
contacts were made via Tenet, fax, and/or telephone 
as needed. NCEO consultants were included in 
additional meetings and met with project staff for 
further study and detailed development of the prod- 
uct document. 

• A collaborative approach was taken for de- 
velopment of the issues and assumptions, uti- 
lizing Group Systems V. Group Systems V is 
a computer-supported collaboration tool that 
allowed for simultaneous and parallel process- 
ing for group interaction. The system allowed 
for idea generation, organization, consensus- 
building, record keeping, and decision-making 

• The goal of each study session was to enable 
all members to evaluate issues, select among 



all options under consideration, and to consider 
each issue within the context of the Texas sys- 
tems of assessment and accountability. 

• Action plan items were generated for each 
issue. These were eventually collapsed, re- 
viewed for duplication, and finalized into 
categories of recommended actions. 



Objective 2; To develop recommended ac- 
tion plan 

Activities 

2a. The report preparation phase was accomplished 
as a collaborative efibrt between Region IV ESC 
staff, serving as the project facilitators, and the 
NCEO consultants. Working together to produce 
the comprehensive final report, the consultants and 
staff submitted drafts of the working docirment to 
the project focus group, advocacy groups, and TEA 
staff for critique and input. Differing perspectives 
were considered for the ongoing revisions to the 
final document 

2b. The initial drafts were submitted to the 
project focus group for review and suggestions 
prior to preparation of the final version in 
September 1995. Dissemination was restricted 
to this group during this phase of the project. 

2c. Ftnal document preparation and dissemina- 
tion to the Tbxas Education Agency was com- 
pleted by September 29, 1995. Further dissemi- 
nation and potential subsequent uses will need 
to be determined by the Texas Education 
Agency. 
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Date 


Activity 


Aprils 


Notification of project award 


April? 


Contact with National Center for Educational Outcomes for 
Students with Disabilities (NCEO) 

- Dr. Jim Ysseldyke 

- Dr. Martha Thurlow 


April 10-13 


Development of outline for briefing paper for initial discussion 


April 21 


Conference with NCEO re: outline, meeting dates, purpose of 
meetings, agendas, process of development of project goals/ 
objectives 


April 24-May 4 


Development of briefing paper, initial meeting agenda, docu- 
ments for nomination of project focus group (stakeholder group) 
representatives 


May 4-10 


Nomination by organizations of project focus group representatives 


May 12 


Project focus group members selected and notified 


May 15 


Review and edit of discussion document 


May 17 


Meeting in Austin with TEA staff (accountability, assessment, legal, 
special education, and evaluation); presentation of project plans 


May 18 


Distribution of briefing paper to project focus group to review prior 
to first meeting 


May 25-26 


Initial meeting in Houston of project focus group; initial develop- 
ment of critical issues 


May 30 


Meeting in Austin with TEA staff; presentation of briefing paper for 
input; discussion of critical issues under consideration 


Junes 


Conference with NCEO; refined work of project focus group; plan 
for subsequent meeting of group 
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Date 


Activity 


June 5-26 


Continued refinemen; and communicated with stakeholder group 
members 


June 26-27 


Meeting in Houston with project focus group; continued develop- 
ment of critical issues and assumptions (info made available to the 
field via Tenet) 


June 29 


Meeting in Austin ^ith TEA staff; shared critical issues, assumptions 
for input 


June 27-July 10 


Communication of projt t focus group members with constituents 
for input; continued feedb'ick and refinement of critical issues; 
request for input for action plan (info made available to the field via 
Tenet) 


July 10 


Meeting in Houston of project focus group to finalize critical issues 
with constituent input; complete development of action plan 
recommendations 


July 11 


Conference with NCEO; input incorporated into issues; draft format 
to be used for final action plan 


July 25 


Conference between NCEO and Region IV ESC project staff to 
revise project document, identify adjustments needed re: constituent 
input 


July 27 


Meeting in Austin with TEA for input re: final critical issues and 
assumptions, initial action plan development 


July 27 


Meeting in Austin with advocacy group to update on all project 
activities, review action plan development 


August 8 


Meeting in Houston of project focus group to incorporate constituent 
input and address action plan development 


August 9 


Region IV ESC project staff and NCEO meeting to revise action plan 
format, revise document draft re: input received 


August 8 - Sept 7 


Refine action plan input from project focus group members, 
advocacy group, TEA staff 
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Date 


Activity 


August 15 


Meeting in Austin with TEA staff to review draft of action plan 
for input recommendations 


August 15 


Meeting in Austin with advocacy group to review current document 
draft and solicit input for draft of action plan 


August 29 


Meeting in Austin with TEA staff to review revised draft of project 
document for input 


September 7 


Region IV project staff and NCEO consultants meeting to determine 
construct revisions for final draft 


September 12 


Meeting in Austin with TEA staff to review major construct revisions 
to be completed, get additional input re: technical issues 


September 15 


Conference with advocacy group re: construct revisions and solicit 
final input 


September 8-29 


Finalize document for technical soundness; edit for readability; 
ongoing communication with TEA, project focus group, advocacy 
groups 


September 26 


Meeting in Austin with Texas Education Agency staff for review of all 
revisions, input to final document for technical accuracy 


September 29 


Final document to Texas Education Agency 
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Appendix B 




A description of what is happening in national data collection programs in the United States, and in the statewide 
assessments of individual states within the U.S., reveals that many issues exist related to the participation of 
students with disabilities in assessments, in the use of accommodations, and in accountability for the results of 
education for students with disabilities. Presented here is a brief synopsis of some of what is known about the 
national picture. 



National Data Collection 



In 1990, the U.S. Department of Education, Office of Special Education and RehabUitative Services, funded the 
National Center on Educational Outcomes (NCEO) at the University of Minnesota to develop a conceptual 
model to guide the process of collecting data on educational outcomes for students with disabilities. Among its 
activities, NCEO worked with the National Center for Education Statistics (NCES) to address ways to increase 
participation of students with disabilities in our nation’s major educational data collection program, the National 
Assessment of Educational Progress (NAEP). 

In the past, NAEP used fairly vague criteria to guide decisions about whether a student on an Individualized 
Education Program (lEP) participated in an assessment. NAEP did not allow the use of any accommodations. 
Under these conditions, approximately 65% of students with disabilities did participate in NAEP (Houser, 

1995). Furthermore, with the guidelines being used and the non-use of accommodations, states were found to be 
extremely variable in their rates of exclusion of students with disabilities (McGrew,Thutiow, & Spiegel, 1993). 
A study by the National Academy of Education (1993) found that the ranking of states would change if states 
had equivalent exclusion rates. To alleviate the difficulties associated with variable exclusion rates, and to have 
a data collection program that included more students with disabilities, in 1995 NAEP field-tested a new set of 
decision criteria for who should take NAEP, and for the first time, allowed the use of several different accommo- 
dation during assessment As recent as September, 1995, the decision was made to include students with 
disabilities in the 1996 NAEP on mathematics. Large enough samples of students with disabilities will be 
obtained to conduct adequate bridging calculations, and to explore the use of accommodations during the ad- 
ministration of NAEP. 



State Assessment Participation 

State tests, for the most part, have been in place a number of years. Initial research conducted by NCEO on state 
practices in assessing students with disabUities indicated that most states did not know the extent of participation 
of students with disabilities in their statewide assessments. For those states that did know, most had extremely 
low percentages of participation (0 - 25%). 



Participation Issues 

In asking about participation of students with disabilities in assessment, NCEO found that the answer depended 
on who was asked and how the question was stated. When NCEO personnel asked special education and 
assessment personnel in the same state, different answers often were given. NCEO also found that the response 
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differed when people were asked about participation in general and when they were asked about participation in 
specific tests G^CEO, 1995). In the years since that initial survey, most states have identified the participation 
rates of students with disabilities. How states fit into different ranges of participation rates is shown in Exhibit 1 . 
Even though much progress has been made in participation rates during the past five years, there remains much 
variance in practice. Forty-three states arc now using statewide assessments. Yet, in only one state (Kentucky) 
do all students participate in the assessment system. Maryland excuses only 1% of their total student population. 

Recent analyses of guidelines for statewide educational assessments (Thurlow, Scott, & Ysseldyke, 1995a; 
Thuiiow, Scott & Ysseldyke, 1995b; Thurlow, Shriner, & Ysseldyke, 1994) indicate that most states now have 
written guidelines for participation and accommodation decisions. The self-reported rules used by states (as of 
1993) to make decisions about the participation of students with disabilities in assessments arc shown in Exhibit 
6 . 

States arc struggling with how to provide assessment and accountability systems in which students with disabili- 
ties participate. These struggles arc giving way to debates about the kinds of accommodations that must be 
made to enable students with disabilities to participate. There is considerable variance in state efforts to date. 
Some states have large documents detailing accommodations that can be made; in others, accommodations are 
not provided, or accommodations are used but results are discounted and eliminated from the reporting system 
(Ysseldyke & Thurlow, 1994). 



Exclusion 

Exclusion can occur at three levels. The first level is during test development. Often, the needs of students with 
disabilities are not considered when tests are developed, nor are students with disabilities included when the 
tests are standardized. When this happens, it limits the number of items in the test that are appropriate for use 
vidth students with disabilities and the appropriateness of normative comparisons. Second, exclusion can occur 
at the time that the tests are administered. This is the most commonly thought of point of exclusion, and 
includes anecdotal exclusions such as the special education class that is sent on a field trip on test day, or the 
individual student who is encouraged to stay at home on a particular day to avoid the disheartening experience of 
taking the Statewide assessment. Part of the issue of exclusion at the time of testing involves whether accorruno- 
dations are allowed during the administration of an assessment. Many students are excluded from an assessment 
when a needed accommodation is not provided or allowed. 

The use of accommodations in state testing is an area in which there has been much change within the past two 
years. Initial research conducted by NCEO on state guidelines for allowable accommodations for studertts with 
disabilities indicated that many different approaches were being taken, some of which were in contradiction to 
others. For example, at that time, Tennessee, unlike many other states, prohibited the provision of extended 
time. Georgia specifically prohibited the interpretation of directions, while nine other states allowed this accom- 
modation. Neatly all states had a reference to the Individualized Education Program (lEP) in their accommoda- 
tion guidelines. The self-reported accommodations allowed by states (as of 1993) are shown in Exhibit 3. 

The third level at which exclusion occurs is in the reporting of results. Students with disabilities sometimes are 
tested, but then their scores are not reported. In some states, the test protocols of students with disabilities arc 
destroyed. Of the 24 states with participation guidelines that address reporting of results for students with 
disabilities, 14 indicate that the data from these students are M aggregated in data reports CThutlow, Scott, & 
Ysseldyke, 1995a). In Oregon’s guidelines, for example, it is noted that for students who take the statewide test 
under modified testing conditions, the tests will be scored and returned to the district, but wilLooi be included in 
the school average. States can get quite detailed in describing what happens to data that are collected from 
students with disabilities. For example, in 1994, North Dakota had the following guidelines for reporting: 
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1 . If the Student is mainstreamed in 50 percent or more of the core courses being tested,. . . the 
student’s test results are to be included in class, grade, district, and state averages. 

2. If the student is mainstreamed in less than 50 percent of the core courses, . . . the student’s 
test results are not to be included in class, grade, district, and state averages. 

3. If a student who has an lEP does not take all sections of the test, or if the student tatfps the 
test under other than standard testing procedures, ... the student’s test results should not be 
included in the class, grade, district, and state averages (North Dakota Department of Pub- 
lic Instracdon, 1994, p.l). 

Other states include more of their students with disabilities in reports. Kentucky aggregates and reports all data 
from students with disabilities and students without disabilities at the home school level, regardless of where 
the student is educated (Thurlow, Scott, & Ysseldyke, 1995a). 



IBI Consequences 

Besides the variations in how states report results from statewide assessments, there are variations in the extent 
to which performance on tests has consequences for districts, schools, school personnel, and students. Student 
consequences typically involve withholding or awarding a high school diploma (or promotion from one grade 
or level of schooling to another). Currently, 17 states use assessments to decide whether a student receives a 
graduation diploma, and 2 additional states are preparing to begin using graduation exams in the next two 
years. How students with disabilities fit within this system varies considerably among those states with gradu- 
ation exams (Thurlow, Ysseldyke, & Anderson, 1995 ). In 10 of the 17 states, students with disabilities must 
pass the graduation exam in order to receive a standard diploma. In these states, if the student with a disability 
completes coursework (including, in some states, modifi^ coursework) but does not pass the exam, a certifi- 
cate is awarded, the same as for all students. In the other states, the student with disabilities may be exempted 
from the exam and still receive a standard diploma. 

Research has confirmed many unintended consequences of these types of assessments. For example, Richard 
Allington and Anne McGill-Franzen (1992) investigated the effects of high-stakes testing on students with 
disabilities. Students in New York state take examinations at periodic intervals, and data on their performance 
are used to make comparisons among districts. Districts report the percentages of their students who pass the 
benchmark examinations. Allington and McGill-Franzen challenged the data finom the third grade exams put 
out by schools, data indicating that in excess of 90% of third graders consistently were passing the benchmark 
tests. The authors obtained data on nine-year-olds (the typical third-grade age), and a very different picture 
resulted. In some instances the percentage of students passing dropped into the mid 60s. They found that many 
nine-year-olds had been retained in second grade or placed in special educatioa When the scores of these 
students were entered into scores for school districts, comparisons among districts changed. 

The practice of excluding students from assessments has been referred to as “academic red shirting.’’ In an 
article that appeared in the American School Board Journal, Zlatos (1994) described a New York community 
school that received a national award for educational excellence, based in part on its high test scores on the 
state’s third grade achievement test (96 percent of the school’s students passed the test). A closer look at the 
data revealed that many of the school’s kinderganen through second grade students had been retained in grade 
or placed in special education. The scores of these students were not included in the school’s average score. 
Quick calculation indicated that if these students had been included, the school’s pass rate would have dropped 
from 96 to 78 percent Zlatos showed that there are major differences among school districts in the numbers of 
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students with disabilities who are included in assessments. Percentages of overall eitrollment in grades tested 
varied from 66% to 93%. No one has a good estimate of the corresponding percentages of students with disabili- 
ties. 

When differing numbers of students and students with different characteristics (e.g., learning disability, limited 
English proficiency) are excluded from district assessments, comparisor.s among districts are invalid. Zlatos 
reached the following simple conclusion: 

Mbc up the variation from state to state and district to district in the type of tests and norms used, 
the grade levels tested, the amount of time spent on test preparation, or d; time of the year the 
test is taken . . . toss in the difference of the number of students excluded, and test scores 
become a witch’s brew of incongruous ingredients. Accountability vanishes, (p. 25) 



Several federal laws that have been enacted within the past few years have implications for state accountability 
systems. Federal fimds associated with the School-to-Work Opportunities Act, the Improving America’s Schools 
Act (formerly the Elementary and Secondary Education Act), and Goals 2000: Educate America Act are tied to 
state assessments that include all students. 

In the spring of 1995, the Office of Special Education Programs (OSEP) issued a request for proposals to fund up 
to four projects designed to study rechnical issues related to including students wiA disabilities in state assess- 
ments. 'The Office of Educational Research and Improvement (OERI) also has issued a call for prt^sals from 
state and local education agencies to develop assessment systems, with a priority on systems that include stu- 
dents with disabilities and students with limited English proficiency. NCEO is working with the Council of 
Chief State School Officers (CCSSO) to form a State Collaborative on Assessment and Student Standards (SCASS) 
that will address the complex issues in participation of students with disabilities in large-scale assessments. A 
SCASS already exists on assessing students with limited English proficiency. 



Summary 

In the past, the division between general and special education created dual systems, each accountable for its 
own results. In most states, compliance monitoring was the assessment and accountability system for special 
education, while the outcomes of general education, if assessed, were assessed by examining pupil performance 
on standardized tests. This approach fails to give a uniform picture of how all students are doing. An account- 
ability system that includes all students can be achieved, regardless of whether students with disabilities are 
served in separate placements or within general education classrooms. 
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Appendix C 




• Results-Based Monitoring for Special Education, Benchmark 1994-95, Texas Education Agency, 
December, 1994 



• State Plan for Fiscal Year 1994-1996 Under Part B of the Individuals with Disabilities Education 
Act (IDEA), Submitted by the State of Texas, Negotiated Revision with Addendum, July, 1995 



• Accountability Manual: The 1995 Accountability Rating System for Texas Public Schools and 
School Districts and Blueprint for the 1996-2(X)0 Accountability Systems, Texas Education Agency, 
Office of Policy Planning and Information Management, February, 1995 



• Long-Range Plan for Public Education, 1996-2000, State Board of Education, Draft, September, 
1995 



• Senate Bill 1 (Enrolled Version): Texas Education Code As Passed by the 74th Texas Legislature, 
May, 1995 



• Senate Bill 1: Summary of Key Provisions in the New Texas Education Code, Capitol Watch, Vol. I, 
Issue 8, Texas Association of School Administrators, June 1, 1995 



• Bri^ng Bool" on Senate Bill 1: 74th Texas Legislature, Texas Education Agency, June, 1995 



• Questions and Answers on Senate Bill 1: Frequently Asked Questions Relating to Senate Bill 1, 
Texas Education Agency, Office of Governmental Relations, July 20, 1995 



• Glossary for the Academic Excellence Indicator System, 1993-94 Report, Texas Education Agency, 
October, 1994 



• Rules and Regulations for Providing Special Education Services, Texas Education Agency, Divi- 
sion of Special Education, August, 1995 
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Appendix D 




During the discussions of the project focus group many issues related to the topics under study arose. How- 
ever, it was acknowledged that they were not included in the chaige to this project In order to ensure that the 
value of each of these was not lost and would in some way be considered in hirther study and development 
they are included here in brief: 

• Implications for Other Student Groups of Students with Special Needs 

Other groups of students with special needs, beyond those who qualify for special education services, should 
also be considered when determining eligibility for accommodations and alternative assessment options. 
Many of these students who are labeled as low performing may be unfairiy designated without accommoda- 
tions or alternative assessment options that might enhance their perfomaance. Their aggregated results may 
also significantly impact district and campus data when held to the standard administration procedures for the 
TAAS. These include, but are not limited to: 

•students eligible under Section 504 of the Rehabilitation Act of 1973, 

•students of limited English proficiency (LEP), 

•students dismissed from special education services who cannot pass the standard TAAS, and 
•low achieving, at-risk students who cannot pass the standard TAAS. 

• Discussions of Appropriateness of TAAS for All Students 

There was discussion about the appropriateness/desirability of the TAAS as the measure used for any of 
Texas’ student populations. It was recognized that considerable resources have been allocated to the develop- 
ment, expansion, and continuous improvement of the current state assessment. TEA'S continued monitoring 
and review of the state assessment meastires in place is suppoited. Ongoing developmem activities should 
continue to include diligent assurance of the alignment of Ae state TAAS objectives with core instructional 
areas. 



•Use of Off-Level Testing 

When accommodations are reviewed and alternative assessments are developed, off-level testing using the 
TAAS may be coasidered as an option for a nonstandard administration. Some smdents may be at a specified 
grade level placement, but may be performing at a different grade level. Off-level testing would not be used 
as comparable TAAS data for accountability puiposes, but would only be used as to determine performance at 
the instructional level being taught. 
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Related Issues (continued) 



• Quality and Use of IndividusJ Educations^ Plans (lEPs) 

Although Individual Education Plans (BEPs) are intended to be used to track the performance of students with 
disabilities, reliance on EEPs as accurate and/or appropriate measures of student improvement has limitations. It 
is recognized that some of the performance indicators in the new Results-Based Monitoring system have been 
designed to address these limitations. However, continuing concerns expressed by the project focus group about 
the development and use of BEPs include: 

• Some personnel are not well trained in appropriate BEP development, 

• BEPs may not always be aligned with content instruction and assessment, 

• BEPs are sometimes not used once they are developed, 

• Age-inappropriate goals/objectives are included in some lEPs, 

• Limited or no change in objectives from year to year has occurred for some students, 

• Limited goal setting and expectations may be included in lEPs, 

• The use of computerized sets of goals/objectives allow for "generic" BEPs, 

• Insufficient input from parents may limit the scope of lEP goals/objectives 

• lEPs are often not used as planning documents as they are intended. 

Some consideration might be given to the scope of monitoring activities related to lEPs and the training 
needed at the preservice and professional levels. 



• High Refeiral/Over-referral for Special Education Services 

High stakes accountability in Texas continues to create the perception and/or concern about high referral rates 
for special education service for students who do not qualify (see attached letter, TEA, 1992). Reporting the 
results of aU students and using the performance results in some way to examine campuses and districts should 
be considered. 



♦ Requirements for Imtitutions of Higher Education 

Qianges in student assessment and accountability have significant implications for education training programs 
in colleges and universities in Ibxas. Standards should be considered for course requirements and field-based 
experiences, considering increasing requirements related to special populations for tdl educators-in-training. 
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Texas 

Xm Ekiucation 



Aeencv 



May 6, 1992 



INFORMATION 

ONLY 



TO THE ADMINISTRATOR ADDRESSED: 



Subject: Special Education Not a Remedy for Seniors Failing the Texas 

Assessment of Academic Skills (TAAS) 



The Texas Education Agency has received numerous calls about seniors being 
referred for special education services when they fail the exit level of the 
TAAS. According to the calls received, the referral usually occurs after the 
student has failed two or more administrations of the test. While possible, 
it is highly unlikely that a student would progress with passing grades to the 
senior level and have a handicapping condition that meets the criteria for 
receiving special education services. 

To be eligible for special education services, an admission, review, and 
dismissal (ARD) committee must determine that the student meets the 
eligibility criteria for one of the handicapping conditions in Title 19 Texas 
Administrative Code, Chapter 89, Subchapter G, Special Education, and has a 
need for special education services. Failing the TAAS does not constitute an 
educational need for special education services. In addition, exempting the 
student from the TAAS is not a special education service. If a student is 
determined to be eligible for special education, it is the district's 
responsibility to preside instructional and related services based on the 
needs of the student, not just on exemption from. the TAAS. 

I am asking for the cooperation of all superintendents and principals in 
contacting your education service center for assistance in helping seniors 
pass the TAAS and in referring for special education services only those 
students suspected of having a handicapping condition. Your attention to this 
should result in more immediate and appropriate help to seniors and in fewer 
seniors being referred just prior to graduation for special education 
assessment - a very costly process. 

If you have questions regarding this issue, please contact the Division of 
Special Education at (512) 463-9414. 
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Texas Assessment of Academic Skills 
Spring 1995 




COORDINATOR MANUAL 



District and Campus 





March Test Administration 

• TAAS Exit Level Writing, Mathematics, and Reading 

• TEAMS Mathematics and English Language Arts 

• TAAS Writing at Grades 4 and 8 



May Test Administration 



• TAAS Mathematics and Reading for Grades 3 through 8 

• TAAS Grade 8 Social Studies and Science 

• TAAS Exit level Writing, Mathematics, and Reading for 
o Graduating Seniors and Out-of-School Examinees 
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ROGRAM 




TAAS 



Testing Modifications 



Certain test administration procedures that do not cause test results to be invalid may 
be used. 

The decision to use a particular modification with a student should be made on an 
individual basis and should take into consideration the needs of the student and 
whether the student routinely receives the modification in classroom instruction. 

Allowable Modifications 

□ Instructions given orally before or after the test may be signed to an examinee 
with a hearing impairment or translated into the native language of an examinee 
with limited English proficiency. Test items, including the written composition 
prompt, must not be signed or translated. 

□ Examinees may place a colored transparency over the test, or they may use a 
place marker with the test and the answer document. 

□ Examinees may receive an individual administration of the assessment 
instrument and, in this setting, may read aloud as they work. 

a The examinee may use a large^rint version of the test. 

a The examinee may use a braille version of the test. 

□ The examinee may use a magnifying glass when testing. 

□ Examinees may respond orally to test items, mark responses in their test 
booklet, or type their responses if they have a disabling condition that interferes 
with their ability to record machine-readable responses. If an examinee must 
dictate a composition, the examinee must spell out all words and indictate all 
capital letters and punctuation marks. Afterward, the examinee must be 
allowed to read over the composition and indicate where he or she would like to 
make corrections. The test administrator must record these responses 
verbatim on a standard answer document. It is recommended that 
administrators write “Transcribed by (NAME) because (REASON)" at the top of 
the answer document. Test responses cannot be scored unless they appear on 
the answer document. 

□ The examinee may type the TAAS written composition on a typewriter or on a 
computer but may not use the computer’s “spell check” feature or save the 
document. The composition must be transcribed onto a regular answer 
document for scoring. It is recommended that administrators write “Transcribed 
by (NAME) because (REASON)” at the top of the answer document. 
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TESTING MOOIFICATIONS 



Nonallowable Modifications 

□ The examinee may not receive any special reading assistance on the writing or 
reading tests. Students who are identified as having dyslexia or a related 
disorder may qualify for an oral administration of the mathematics. Grade 8 
social studies, and/or Grade 8 science tests. 

□ The examinee may not use a calculator. 

□ The examinee may not use a slide rule. 

□ The examinee may not use English-language or foreign-language reference 
materials. 

□ Other modifications that would make the test invalid are prohibited. 



Oral Administration 

A test administrator may read aloud the test questions and answer choices for the 
mathematics, Grade 8 social stud.js, and/or Grade 8 science tests to those eligible 
TAAS examinees who are identified as having dyslexia or a related disorder and who 
regularly receive this modification in the classroom. This modification is available only 
for the mathematics, social studies, and science sections of the TAAS test. It is not 
available for the TEAMS test. 

The decision to provide an oral administration to students receiving special education 
services should be made by the student’s admission, review, and dismissal committee. 
For students not in special education, this determination rests with the committee that is 
required by Section 504 of the Rehabilitation Act of 1973 to make the student’s 
placement decisions. Directions for reading aloud the mathematics, social studies, and 
science tests are in Appendix B. 






Modifications that would invalidate the test should not be used for exempt 
students who test if results are to be compared to results for non-exempt 
students. 



TESTING MODIFICATIONS 
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End-of-Course 



Test Eligibility 
1 ) 



AU students who are scheduled to complete the second semester of I or 

a Biology I course in May must take the end-of-course exammauon. This mcludes 
student of limited EngUsh proficiency and smdents served through special educauon. 



Exceotion* A special education student whose admission, review, and dismissal (ARD) 
c^^ttee spet^ies in the individual educational plan (lEP) the need for conrenr 
modification in the course will not be required to take an end-of-course exammauon. 

In such a case, the following points should be kept in mind: 

. Testing is not appropriate because the student’s disability prevents him or her from 

mastering part of the actual coarse conrem. . ,u 

• Course credit for a smdent with content modification will be accompamed by the 

letter “S” on the smdenttranscripL 

. A distria may give the test to the smdent for local purposes. The C” in the bcoie 
Code” field on the answer document should be marked so that the smdent s test wi 
not be scored by the state. However, the answer document must be submitted but will 
be scanned for demographic information only. 

2) Smdents who arc scheduled to complete the second semester of Algebra I or Biology I 
prior to May may take the end-of-course examination. 

3) Smdents who are retaking the first semester of Algebra I or Biology I are not required to 



Test Modifications 

tost administration procedures that do not invalidate test results may be used. 



Tba decision to use a particular modification with a smdent should be i^ on an individual 
basis and should take into consideration the needs of the smdent and whether the smdent 
routinely receives the modification in classroom instruction. 



Modifications Allowable in a Standard Administration 

. Instructions given orally before or after the test may be signed to a smdent wth a 
hearing impairment or translated into the native language of a smdent with limited 
pn giish proficiency. 

• A smdent may place a colored transparency over the test or use a place maricer 
with the test and answer document 

. Smdents may receive an individual administration of the assessment instnin /mt 

and, in this setting, may read aloud as they woric. 



. A smdent may use a large-print version of thfe test 



• A smdent may use a braille version of the test 



. Smdents may respond orally to test items, mark responses in their test b^Wet or 
type responses if they have a disabling condiUon that interferes with their abihty 
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to record machine-readable responses. The test administrator must record these 
responses verbatim on a standard answer documer*. It is recommended that 
administrators write ‘Transcribed by (NAME) because (REASON)” at the top 
of the answer document. 



Modifications Allowable in a Nonstandard Administration 

Ceitain nonstandard administration procedures may be necessary for students who are 
required to test The use ot^ nonstandard administration procedure must be indicated on 
the student’^ answer document and will be noted on the student’s performance report. The 
following modifications are allowable in a nonstandard administration. 

• A student with dyslexia or a related disorder may receive an oral administration of 
an end-of-course test 

• A limited English proficient smdent may use a dictionary that provides translations 
of English words if such a dictionary is used as part of his or her regular classroom 
instruction. 

• A limited English proficient smdent may have words on the test translated into his 
or her native language if this assistance is part of his or her regular classroom 
instruction. In providing a smdent with translation assistance, only native-language 
equivalents for English words or phrases may be given. The translator must be 
careful not to provide interpretations that would allow the smdent an advantage in 
aniving at z conect response. 



The dec isio n to provide an oral administration to smdents receiving special education 
services should be made by the smdent’s admission, review, and dismiss^ commi^e. For 
smdents not in special education, this determination rests with the committee that is 
required by Section 504 of the Rehabilitation Act of 1973 to make the smdents’ placement 

decisions. 



The decision to allow the use of a bilingual dictionary or a translator should be made by the 
district and should take into account the individual needs of the smdent and whether the 
smdent routinely receives the modification in classroom instruction. 



If a student receives any of the modifications allowable in a nonstandard 
administration, the test administrator must complete the field “NS" 
(nonstandard administration) on the front of the answer document 



Test Materials 

The Austin Operations Center sent an order form to all districts in January allowing them 
to order the number of booklets needed. The number of test booklets a distria is scheduled 
to receive for the Alg ibra I and Biologj* I tests will be based on the number ordered by 
districts. 

End-of-course materials will be received and remmed separately from TAAS materials. 
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